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radar  image  fornatlon  were  designed  and  experimentally 
demonstrated.  The  radar  imaging  processor  is  capable  of  forming 
images  in  real  time  with  relatively  low  size  and  power 
requirements.  Several  processors  were  also  developed  for 
pattern  recognition  applications  and  an  acoustooptic  system 
capable  of  producing  two  dimensional  correlations  of  images  at 
standard  video  rates  was  experimental ly  demonstrated.  The  same 
signal  processing  method  was  applied  to  two  dimensional  spectrum 
analysis  and  the  processing  of  signals  from  broadband  adaptive 
phased  arrays.  In  both  Instances  acoustooptic  architectures  were 
developed  and  initial  experimental  demonstrations  were 
performed . 
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Tlae-and-spaoe  Integrating  processing 

A  primary  motivation  for  this  work  has  been  the 
availability  of  well  developed  acoustooptic  devloes  and  the 
desire  to  use  these  devices  in  performing  two  dimensional 
processing.  Traditionally,  optical  image  processing  was  done 
exclusively  with  two  dimensional  spatial  light  modulators  and  the 
lack  of  well  developed  devices  of  this  type  has  long  been 
considered  a  major  Impediment  for  progress  in  optical  image 
processing.  If  we  could  find  effective  ways  for  processing  images 
using  well  developed  acoustooptic  devices,  then  this  can  open  the 
way  for  rapid  progress  to  take  place. 

Acoustooptic  devices  are  one  dimensional  spatial  light 
modulators  and  in  order  to  use  them  in  an  image  processor  it  is 
necessary  to  find  ways  for  representing  and  processing  2-D 
signals  with  one  dimensional  devices.  The  method  we  developed 
involves  a  combination  of  temporal  and  spatial  representation  of 
the  signals.  Accordingly,  the  processing  of  the  data  is 
accomplished  by  a  combination  of  temporal  and  spatial 
Integrations  in  the  optical  system,  hence  we  refer  to  this  method 
as  tlme-and-space  integrating  processing.  In  all  these 
processors,  both  transverse  spatial  dimensions  of  the  optical 
system  are  used.  There  is  great  deal  of  flexibility  in  designing 
such  architectures,  resulting  from  the  choices  that  exist  on 
how  to  combine  spatial  and  temporal  integrations  and  how  to 
arrange  one  dimensional  devices  in  the  three  dimensional  optical 


aystea.  We  have  explored  these  arohiteotural  possibilities  in 
depth.  The  results  of  this  investigation  have  been  summarized  in 
a  review  article  listed  as  Publication  #1  in  this 
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report. 

The  primary  result  from  our  Investigation  on  two  dimensional 
acoustooptic  architectures  is  that  it  is  possible  to  implement  a 
wider  class  of  2-D  signal  processing  operations  using  one 
dimensional,  acoustooptic  devices  rather  than  two  dimensional 
spatial  light  modulators.  Moreover,  it  is  often  possible  to 
electronically  control  the  operation  being  performed  in  a  very 
natural  way,  in  the  acoustooptic  image  processing  architectures 
making  a  degree  of  programmability  possible.  On  tbe  negative 
side,  since  processing  is  partially  done  by  temporal 
Integration,  the  output  signal  forms  on  top  of  a  bias,  a 
characteristic  of  all  time  Integrating  processors.  A  consequence 
of  this  bias  built-up  is  reduced  dynamic  range.  We  have 
investigated  several  methods  for  reducing  tbe  bias  in  tbe 
architectures  we  have  considered  and  we  have  concluded  that  in 
almost  all  cases,  if  tbe  system  is  properly  designed,  the  dynamic 


a  range  that  is  obtainable  is  sufficient  for  practical 
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y  Four  separate  image  processing  application  areas  were 
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selected  for  which  specific  architectures  were  developed  and 
experimentally  demonstrated:  synthetic  aperture  radar,  image 
correlation,  two  dimensional  spectrum  analysis,  and  adaptive, 
broadband  phased  arrays.  The  results  from  our  investigation  in 
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each  of  these  areas  have  been  previously  published.  In  what 
follows  we  will  highlight  our  results  In  each  area  and  Identify 
the  relevant  references  where  sore  detailed  descriptions  can  be 
found . 


Synthetic  Aperture  Bader 


Synthetic  Aperture  Radar  Is  the  oldest  and  still  the  most 
successful  application  of  optical  signal  processing  techniques. 
Also  it  is  a  two  dimensional  signal  processing  problem  and  hence 
it  was  the  most  obvious  problem  to  which  our  acoustooptic 
processing  method  could  be  applied.  The  advantage  of  using 
acoustooptics  versus  photographic  film,  Is  real  time  operation 
a  relatively  compact  and  power  efficient  system.  The  details  of 
the  operation  of  the  acoustooptic  SAR  processor,  several  modified 
architectures,  and  the  experimental  demonstration,  have  been 
documented  in  publications  #5»  #6,  and  #7.  Here  we  present  a 
sample  of  the  experimental  results.  The  system  block  diagram  is 
shown  in  Figure  la.  The  processor  accepts  the  radar  signal  and 
produces  at  its  output  the  focused  radar  image  as  a  video  signal 
which  can  be  readily  displayed  on  a  monitor.  A  photograph  of  the 
experimental  set-up  is  shown  in  Fig. 1b.  The  focused  image  of  a 
simulated  point  target  produced  in  real  time  by  the  acoustooptic 
system  is  shown  in  Figure  1c. 

Several  modifications  to  the  basic  SAR  architecture  were 
implemented  allowing  the  imaging  operation  to  be  controled 
electronically  in  order  to  accommodate  dynamic  changes  in  the 
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radar  geometry.  Most  significantly,  in  publications  #6  and  #7  we 
report  on  an  architecture  in  which  the  two  dimensional  mask  that 
is  used  in  the  system  of  Fig.  1  is  replaced  by  a  second 
acoustooptic  device. 

Aooustooptio  Image  Correlators 

Optical  image  correlation  for  pattern  recognition 
applications  was  proposed  by  VanderLugt  over  20  years  ago.  This 
technique  has  the  potential  for  the  most  wide  applicability  of 
optical  signal  processing  methods.  There  are  two  basic 
limitations  that  have  so  far  prevented  optical  correlators  from 
being  used  in  practice:  lack  of  two  dimensional  devices  and  the 
limitations  of  correlation  based  pattern  recognition  algorithms. 
The  use  of  acoustooptic  devices  in  place  of  two  dimensional 
spatial  light  modulators  obviously  addresses  the  first  problem. 
An  acoustooptic  image  correlator  was  capable  of  processing  images 
at  30  frames  per  second  (or  faster)  was  demonstrated.  This  system 
is  described  in  detail  in  publication  #2  and  initial  experimental 
results  are  presented  in  publication  #3.  In  Figure  2  we  present 
more  recent  experimental  results  from  this  processor.  Shown  in 
figure  2  are  the  auto  and  cross  correlations  between  two  selected 
images  produced  at  video  rates  by  the  acoustooptic  correlator. 

The  excellent  quality  of  the  results  we  obtained  with  the 
acoustooptic  image  correlator,  have  led  us  to  the  conclusion 
that  the  implementation  limitation  of  optical  correlators  cannot 
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be  considered  as  a  major  problem  preventing  optical  correlators 
from  being  used  in  practical  pattern  recognition  applications.  It 
is  the  limitations  of  the  simple  correlation  algorithm  that  need 
to  be  overcome  now.  To  tils  end  we  have  investigated 
architectures  where  the  reference  image  in  the  correlator  can  be 
digitally  programmed.  This  capability  opens  new  algorithmic 
possibilities  that  show  promise  for  overcoming  the  limitations  of 
the  correlation  algorithm.  The  architecture  described  in 
publication  #4  is  an  acoustooptic  image  correlator  in  which  the 
reference  image  is  stored  in  an  electronic  memory  and  thus  it  can 
be  directly  updated  by  an  electronic  digital  computer. 

Speotrua  Analysis 

Two  dimensional  spectrum  analysis  has  two  basic 
applications.  The  first  is  the  formation  of  the  spectrum  of 
Inherently  two  dimensional  signals  (Images).  It  is  known  however 
that  the  2-D  transform  of  a  raster  reoorded  1-D  signal,  is 
approximately  equivalent  to  the  raster  recording  of  the  1-D 
transform  of  the  same  signal.  Hence,  a  2-D  spectrum  analyzer  can 
be  used  for  producing  very  fine  resolution  spectra  of  one 
dimensional  signals  over  a  broad  bandwidth.  2-D  acoustooptic 
spectrum  analyzers  are  actually  better  suited  fot  this  latter 
application  because  they  can  accept  the  one  dimensional  signal 
directly  and  the  "raster  recording"  step  occurs  automatically 
during  the  computation  of  the  spectrum.  Several  architectures 
were  developed  and  compared.  These  are  described  in  publication 
#8  along  with  initial  experimental  results. 
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Our  Investigation  in  this  area  is  not  complete  but  there  are 
some  general  observations  that  we  can  make  at  this  stage.  The 
first  is  that  the  electronic  cirouits  that  are  necessary  for 
generating  the  signals  that  are  required  for  the  operation  of  the 
acoustooptic  spectrum  analyzer  are  relatively  complex.  Secondly, 
the  dynamic  range  reduction  due  to  the  bias  built-up  can  be  a 
particularly  serious  problem  for  spectrum  analysis.  Thus  our 
efforts  are  now  concentrated  towards  solving  these  two  problems. 

Adaptive  Phased  Arrays 

Processing  signals  from  broadband,  antenna  arrays  is  a  two 
dimensional  signal  processing  problem;  we  have  the  time  history 
of  an  array  of  signals,  one  from  each  antenna  element.  For  the 
narrowband  case,  beamforming  (i.e,  spatial  processing)  and 
temporal  filtering  can  be  done  independently  as  two  cascaded 
operations.  In  the  broadband  case  however  temporal  and  spatial 
processing  are  Inherently  coupled  and  the  problem  must  be  treated 
as  two  dimensional.  There  are  several  distinctions  between  this 
two  dimensional  signal  processing  problem  and  the  problems 
discussed  earlier.  These  distributions  translate  to  marked 
differences  in  the  optical  architectures  that  are  needed  for 
solving  these  problems.  The  input  signal  in  this  case  an  array  of 
temporal  signals  which  has  led  us  to  consider  multiple  transducer 
acoustooptic  devices  as  input  spatial  light  modulators.  Another 
major  difference  is  that  for  adaptive  processing,  the  operation 
required  is  a  cascade  of  two  2-D  filters;  the  output  of  one 
filter  becomes  an  input  to  the  second.  Finally  there  is  feedback 
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which  raises  the  Issue  of  stability.  These  considerations  have 
led  to  very  interesting  new  architectural  designs.  These  are 
described  In  publications  #11  and  #12.  Also  presented  In  these 
publications  are  Initial  experimental  results  from  these 
architectures . 

As  described  in  the  publications  mentioned  above,  there  are 
two  basic  architectural  choices.  Either  a  fully  space  integrating 
system,  l.e.  both  required  filters  are  performed  using  a  space 
integrating  architecture  or  a  hybrid  time/space  integrating 
architecture.  The  advantage  of  the  fully  space  integrating  system 
is  that  the  active  devices  required  for  its  implementation, 
acoustooptic  devices  and  detectors,  are  well  developed  and 
readily  available.  In  addition,  the  space  integrating 
architectures  have  last  adaptation  time.  The  disadvantage  of  the 
space  integrating  architectures  is  susceptibility  to 
oscillations.  The  problem  with  building  a  time/space  integrating 
adaptive  processor  onthe  other  hand,  is  that  the  output  of  the 
time  integrating  system  needs  to  become  the  input  to  the  space 
integrating  processor  (see  publication  #12  ).  Normally,  the 
output  in  a  time  integrating  processor  forms  on  a  detector  array. 
The  requirement  for  electronically  reading  out  the  array  before 
driving  the  next  stage,  would  render  this  approach  impractical. 
We  have  investigated  the  use  of  photoref ractive  crystals  as  a 
time  integrating  medium.  The  result  of  the  temporal  integration 
in  this  case  is  stored  in  the  crystal  and  it  can  be  gEiiflalls 
addressed.  Consequently,  the  time  and  space  integrating  systems 
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oao  be  direotly  cascaded.  This  technique  is  discussed  In 
publication  #20.  This  method  has  yielded  what  we  feel  are 
excellent  results,  and  It  is  applicable  not  only  to  this 
adaptive  filtering  problem,  but  it  creates  the  possibility  for  a 
new  class  of  acoustooptic  architectures. 
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Two-Dimensional  Optical  Processing 
Using  One-Dimensional  Input  Devices 

DEMETRI  PSALTIS,  MEMBER,  IEEE 
Invited  Piper 


Two-dimensional  optical  processing  architectures  that  are  imple¬ 
mented  with  one-dimensional  input  spatial  light  modulators  are 
reviewed.  The  advanced  state  of  the  art  of  available  one-dimen¬ 
sional  devices  and  the  flexibility  that  exists  in  the  design  of  two-di¬ 
mensional  architectures  with  one- dimensional  transducers  leads  to 
the  implementation  of  the  most  powerful  and  versatile  optical 
processors.  Signal  and  image  processing  architectures  of  this  type 
are  discussed. 

I.  Introduction 

Optical  information  processing  systems  can  be  config¬ 
ured  in  two  or  three  spatial  dimensions,  one  of  the  dimen¬ 
sions  being  the  optical  axis  of  the  system  along  the  general 
direction  in  which  light  propagates.  As  light  propagates 
through  the  system  it  is  modulated  by  input  data  and 
transformed  to  produce,  at  the  output  plane,  a  light  distri¬ 
bution  modulated  by  the  processed  data  (the  result  of  the 
computation).  Light  modulators  and  optical  processing  ele¬ 
ments  are  typically  placed  in  planes  perpendicular  to  the 
optical  axis.  An  optical  processor  is  reftrr  -I  to  as  one-  or 
two-dimensional  (1-D  or  2-D)  depending  u  whether  one 
or  two  of  the  transverse  coordinates  of  the  optical  system 
are  used.  The  majority  of  the  early  optical  information 
processing  systems  were  2-D  processors  [1]-[3].  The  2-D 
space  provides  large  parallel  processing  capability  that  gives 
optical  processors  the  potential  for  extremely  high  process¬ 
ing  power.  In  addition,  the  inherent  2-D  processing  capabil¬ 
ity  makes  optics  a  signal  processing  technology  that  is 
uniquely  suited  for  image  processing  applications,  which 
typically  require  extensive  computations.  Indeed,  the  first 
successful  application  of  optical  information  processing  sys¬ 
tems  was  in  the  area  of  image  processing,  particularly  in 
synthetic  aperture  radar  (2)  and  pattern  recognition  [3].  1-D 
processors  were  developed  subsequently,  primarily  due  to 
the  emergence  of  acoustooptic  devices  (AODs)  as  broad¬ 
band,  high-quality  electronic-to-optical  transducers  [4],  The 
acoustooptic  spectrum  analyzer  is  the  most  widely  used 
processor  of  this  type,  consisting  simply  of  an  AOD,  a  1-D 
Fourier  transforming  lens,  and  a  linear  detector  array  (5].  In 
recent  years,  a  new  generation  of  2-D  optical  architectures 
has  emerged.  These  architectures  are  implemented  with 
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1-D  input  devices  but  are  configured  in  three  spatial  dimen¬ 
sions.  The  classical  2-D  processors,  which  are  implemented 
with  2-D  spatial  light  modulators  (SLMs)  [6J,  [7],  process 
data  in  a  relatively  straightforward  manner,  typically  using 
spherical  lenses  to  perform  Fourier  transformations  or  2-D 
shift-invariant  operations.  The  implementation  of  2-D 
processors  with  1-D  devices  is  usually  less  straightforward, 
but  greater  flexibility  exists  in  designing  such  systems.  Con¬ 
sequently,  many  new  architectures  have  emerged  in  a  rela¬ 
tively  short  time,  in  which  broad-band,  high-quality  1-D 
devices  have  been  incorporated  in  the  2-D  optical  system 
to  produce  the  most  powerful  and  versatile  optical  com¬ 
puters  to  date.  We  will  examine  in  this  paper  the  methods 
that  have  been  proposed  for  implementing  such  processors. 
Before  we  proceed  with  descriptions  of  specific  architec¬ 
tures  we  will  discuss  in  this  introductory  section  general 
characteristics  of  processors  of  this  type 

The  most  direct  motivation  for  using  1-D  devices  is  their 
advanced  state  of  the  art.  In  recent  years,  numerous  optical 
devices  have  been  developed,  usually  for  applications  other 
than  optical  information  processing.  Nevertheless,  many  of 
these  devices  have  been  effectively  used  as  input  or  output 
transducers  in  1-D  optical  processors.  AODs,  semiconduc¬ 
tor  light  sources  (laser  diodes  and  LEDs)  [8],  and  semicon¬ 
ductor  detectors  (photodiodes  and  CCDs  (9],  [10])  are  the 
components  that  have  been  most  widely  used  in  this 
manner.  The  relatively  small  size  of  these  devices  combined 
with  advanced  computer-aided  lens  design  techniques  has 
led  to  the  development  of  miniaturized  optical  systems  [11]. 
In  addition,  the  relatively  low  power  consumption  and  cost 
of  the  devices  has  made  it  possible  to  implement  optical 
processors  that  are  advantageous  not  only  in  terms  of  speed 
but  also  in  terms  of  power  requirement,  size,  and  cost. 
These  practical  considerations  provide  strong  impetus  for 
using  these  same  devices  to  implement  2-D  processors  with 
similar  properties. 

The  ability  to  configure  the  processor  in  three  dimen¬ 
sions  is  a  property  unique  to  optics  among  signal  process¬ 
ing  technologies.  It  is  crucial  to  utilize  the  third  dimension 
effectively  because,  in  general,  it  is  this  property  that  gives 
optics  a  clear  advantage  over  alternate  technologies.  There¬ 
fore,  an  important  question  is  whether  2-13  optical 
processors  that  are  configured  with  1-D  devices  can  have 
sufficient  processing  power,  because  the  full  potential  of 
the  three-dimensional  optical  system  can  only  be  realized 
with  the  classical  implementation  of  a  2-D  processor  utiliz¬ 
ing  2-D  SLMs.  If  such  a  processor  is  configured  to  perform 
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2-D  correlations,  then  each  of  106  samples  that  are  stored 
on  a  2-0  SIM  at  the  input  plane,  is  multiplied  by  10b 
samples  stored  on  a  second  2-D  SLM  placed  in  the  spatial 
frequency  plane.  This  massive  parallelism  and  interconnec¬ 
tion  capability  results  in  a  processing  rate  equivalent  to  10'4 
analog  multiplications  per  second,  assuming  that  the  input 
SLM  is  updated  at  100  frames  per  second.  When  the  input 
device  is  1-D,  some  of  this  parallelism  is  lost  since  only 
103-104  samples  can  now  be  represented  in  the  input 
plane,  at  one  time.  The  loss  in  parallelism,  however,  is 
compensated  for  by  the  very  high  bandwidth  of  the  avail¬ 
able  1-D  devices.  For  instance,  consider  a  processor  that  is 
implemented  with  a  linear  array  of  100  laser  diodes  as  the 
input  device.  Each  laser  diode  can  be  separately  modulated 
with  a  bandwidth  equal  to  1  GHz,  and  therefore  the  input 
data  can  be  updated  every  1  ns.  The  processing  power  in 
this  case  can  exceed  1014  analog  multiplications  per  second, 
if  the  light  from  each  laser  diode  is  multiplied  by  at  least 
103  samples  in  the  optical  system.  It  is  actually  possible  to 
multiply  each  laser  diode  with  up  to  10b  samples  and  thus, 
given  the  properties  of  the  devices  that  are  available,  larger 
processing  power  can  be  obtained  with  a  2-D  optical 
processor  if  it  is  implemented  with  1-D  devices.  Notice  that 
in  the  above  example,  the  103  interconnections  are  only  a 
small  fraction  of  the  interconnection  capacity  of  the  2-D 
optical  system,  yet  they  are  sufficient  to  yield  very  high 
processing  power  due  to  the  use  of  the  broad-band  input 
devices. 

A  consequence  of  the  reduced  utilization  of  the  inter¬ 
connection  capacity  of  the  optical  system  is  increased  flexi¬ 
bility.  The  2-D  Fourier  transforming  lens  is  the  primary 
mechanism  that  is  used  to  make  all  the  possible  inter¬ 
connections  in  a  2-D  optical  processor  However,  only  a 
relatively  small  number  of  linear  operations  can  be  per¬ 
formed  with  a  processor  based  on  the  2  D  Fourier  trans¬ 
form  It  is  in  fact  possible  to  compute  a  wider  class  of  linear 
operations  through  combinations  of  imaging  and  1-D  trans¬ 
forming  (or  integrating)  lenses.  Furthermore,  greater  flexi¬ 
bility  exists  in  the  design  of  such  processors,  permitting  the 
optimization  of  the  optical  architecture  so  that  a  particular 
operation  is  performed  in  a  manner  that  is  matched  to  the 
requirements  of  each  application. 

A  second  important  consequence  of  the  use  of  broad¬ 
band  transducers  has  been  the  development  of  "dynamic" 
2-D  optical  processors.  Time  plays  a  passive  role  in  a  classi¬ 
cal  2-D  processor,  data  are  placed  at  the  input  plane,  they 
are  processed  by  spatial  integration  in  the  optical  system, 
and  then  a  time  interval  elapses  during  which  the  last  result 
is  read  out  and  a  new  block  of  data  is  entered  in  the  optical 
processor  The  incorporation  of  devices  such  as  AODs  and 
CCDs,  which  have  the  capability  of  transfering  data  not 
only  into,  but  also  through  the  optical  system,  results  in 
dynamic  optical  processors  in  which  different  calculations 
are  continuously  being  performed  Time  integration  is  an 
example  of  dynamic  optical  processing  (12],  (13]  As  data 
flow  through  a  time  integrating  system,  computations  are 
continuously  performed  and  the  partial  results  are  stored 
(accumulated)  on  the  optical  detector  by  buildup  of  photo¬ 
generated  charge  Recently,  a  more  deliberate  utilization  of 
the  time  domain  has  been  achieved  through  systolic  1-D 
and  2-0  optical  processing  [14]-(17],  Systolic  optical 
processing  is  addressed  in  a  separate  paper  m  this  issue  A 
byproduct  of  dynamic  processing  is  increased  programma¬ 


bility  in  such  systems.  Usually,  the  operation  performed  is 
controlled  by  electrical  signals  externally  applied  and  it  is  a 
relatively  easy  task  to  reprogram  the  processor  by  changing 
these  signals  with  an  electronic  processor  that  is  interfaced 
to  the  optical  system. 

In  summary,  practical  as  well  as  powerful  2-D  optical 
processors  can  be  implemented  using  1-D  input  devices, 
primarily  because  of  the  advanced  state  of  the  art  of  the 
available  components.  Furthermore,  such  systems  are  par¬ 
ticularly  versatile  due  to  the  latitude  that  exists  in  designing 
the  spatial  configuration  as  well  as  the  timing  of  these 
architectures.  In  the  remainder  of  the  paper  we  explore 
these  issues  further  by  discussing  several  processors  of  this 
type.  The  architectures  that  will  be  described  are  imple¬ 
mented  with  astigmatic  optical  systems,  typically  consisting 
of  a  combination  of  spherical  and  cylindrical  lenses  in 
conjunction  with  the  active  devices  used  in  each  case.  Even 
within  this  relatively  narrow  framework,  it  is  not  possible  to 
cover  all  the  systems  that  have  been  proposed  Instead, 
several  representative  architectures  were  selected,  partial Iv 
because  of  their  significance  but  also  because  they  were 
judged  to  be  suitable  for  conveying  crucial  concepts. 

The  processors  that  will  be  discussed  are  all  implemented 
with  AODs  and  arrays  of  laser  diodes  (LDs)  or  LEDs  as  input 
devices.  There  are  other  1-D  devices  that  can  be  used 
instead,  such  as  the  array  of  electrooptic  modulators  that 
was  recently  fabricated  at  Xerox  [59]  or  the  CCD  spatial  light 
modulator  that  is  being  developed  at  Lincoln  Laboratory 
(60],  AODs,  LEDs,  and  LDs  are  used  throughout  the  paper 
because  these  levices  have  been  primarily  used  in  practice 
and  also  because  they  are  representative  of  the  two  basic 
types  of  1-D  input  devices.  In  a  LED  or  LD  array,  each 
element  of  the  array  can  be  individually  modulated,  and 
thus  an  entire  line  of  data  can  be  entered  into  the  optical 
processor,  in  parallel,  in  a  time  approximately  equal  to  the 
inverse  of  the  bandwidth  of  the  individual  devices  (1  ns  for 
LDs)  On  the  other  hand,  data  are  entered  serially  into  the 
optical  system  when  an  AOD  is  used.  If  the  voltage  applied 
to  an  AOD  is  temporally  modulated  by  f(t),  then  the  light 
diffracted  by  the  device  is  modulated  by  f(t  -  x/v),  where 
x  is  the  spatial  coordinate  along  the  direction  of  propaga¬ 
tion  of  the  acoustic  wave  and  v  is  the  acoustic  velocity.  At 
any  time,  t,  the  diffracted  light  is  spatially  modulated  pro¬ 
portionally  to  a  portion  of  the  electrical  signal  applied  to 
the  device,  equivalently,  at  any  position,  x.  the  light  is 
temporally  modulated  by  the  input  signal  This  dual  modu¬ 
lation  is  important  for  the  synthesis  of  dynamic  optical 
processors  because  AODs  can  be  used  not  only  as  input 
devices  but  also  as  delay  lines  in  the  optical  processor 

The  modulation  introduced  by  the  AOD  is  actually  more 
complicated  [4],  the  diffracted  light  is  Doppler  shifted  to 
the  center  frequency  of  the  AOD,  the  finite  aperture  of  the 
device  places  a  limit  on  the  spatial  extent  over  which 
the  modulation  takes  place,  and  the  approximation  that  the 
modulation  is  proportional  to  the  applied  electrical  signal  is 
valid  only  if  the  diffraction  efficiency  of  the  device  does  not 
exceed  a  few  percent  (18)  Furthermore,  the  modulation 
properties  of  AODs  depend  strongly  on  the  angle  of  inci¬ 
dence  of  the  illuminating  light,  an  aspect  that  becomes 
particularly  important  in  the  design  of  astigmatic  systems 
since  in  these  architectures  AODs  are  often  illuminated 
with  uncollimated  light  [19]  All  these  factois  musi  be  taken 
into  consideration  in  the  design  of  a  practical  system  Hovs- 
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ever,  since  our  purpose  in  this  paper  is  to  desc-*-*  the 
functional  operation  of  2-D  processor  architectures,  the 
simple  form  of  the  modulating  function,  /( t  -  x/v),  will  be 
used  except  in  cases  where  the  additional  factors  play  a 
vital  part  in  the  architecture.  In  architectures  that  are  imple¬ 
mented  with  incoherent  light  or  where  operations  are  per¬ 
formed  on  detected  signals  (time  integrating  processors), 
bipolar  signals  are  typically  placed  on  a  bias  so  that  they 
can  be  represented  by  light  intensity,  which  is  a  positive 
quantity.  For  clarity,  the  details  of  biasing  in  such  systems 
will  be  suppressed. 

The  rest  of  the  paper  is  divided  in  three  sections.  The 
following  section  examines  multichannel  systems.  2-D  opti¬ 
cal  processors  for  processing  1-D  signals  are  discussed  in 
Section  III,  and  the  final  section  is  devoted  to  optical 
processors  capable  of  processing  2-D  signals  (images). 

ll.  muitichannu  Processors 

The  basic  linear  operations  (Fourier  transform,  convolu¬ 
tion,  and  correlation)  can  be  implemented  with  1-D  optical 
processors  in  a  variety  of  ways  [5],  (20).  The  majority  of 
these  architectures  are  (or  at  least  can  be)  implemented 
using  AODs  as  electronic-to-optical  transducers.  Such  sys¬ 
tems  are  successfully  used  in  practice  even  though  they  are 
in  direct  competition  with  other  analog  and  digital  1-D 
signal  processing  technologies,  primarily  because  of  the 
high  bandwidth  of  AODs,  which  can  exceed  1  GHz.  The 
result  is  a  processing  rate  that  cannot  be  easily  achieved 
with  alternate  technologies.  The  processing  power  of  a  1-D 
optical  processor  can  be  increased  further  by  a  factor  of  102 
to  103  by  simply  performing  the  same  basic  1-D  operation 
in  all  the  available  channels  along  the  second  dimension  of 
the  optical  system  Such  multichannel  processors  were  pro¬ 
posed  early,  for  instance  by  Cutrona  in  his  classic  paper  in 
1964  (1]  These  systems  are  useful  in  applications  where  one 
wishes  to  process  a  signal  in  many  different  ways,  or  alter¬ 
natively  when  the  same  processing  operation  is  to  be  per¬ 
formed  on  a  number  of  different  signals  simultaneously 

The  system  shown  in  fig.  1  is  an  example  of  a  multichan¬ 
nel  1-D  space  integrating  correlator.  The  input  signal  f(t)  is 
applied  to  the  AOD  in  Fig.  1.  The  AOD  is  illuminated  by  a 
coherent  light  source  The  spherical  lens  l ,  is  a  collimating 
lens  and  the  cylindrical  lens  L2  focuses  the  light  in  the 
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Fig.  1.  Multichannel  space  integrating  correlator 


vertical  direction  onto  the  AOD.  The  amplitude  of  the 
diffncied  light  is  modulated  by  f(t  —  x/v),  where  x  is 
the  horizontal  spatial  dimension  and  v  is  the  acoustic 
velocity.  The  undiffracted  light  transmitted  through  the 
AOD  is  blocked  in  the  focal  plane  of  the  spherical  lens  l3, 
whereas  the  diffracted  light  is  collimated  in  the  vertical 
dimension  by  l3.  In  the  horizontal  dimension,  l3  and  the 
cylindrical  lens  l4  produce  an  image  of  the  diffracted  light 
at  plane  P2.  The  light  illuminating  plane  P}  is  therefore 
modulated  by  f(t  +  x/v)  and  is  uniform  in  the  vertical  ( y) 
dimension.  A  2-D  transparency  with  amplitude  trans¬ 
mittance  h(x,y)  is  placed  at  P2.  The  amplitude  of  the 
light  transmitted  through  P2  is  modulated  by  the  product 
f(t  -  x/v)h(x,  y).  The  combination  of  the  cylindrical  lens 
and  the  spherical  lens  Lb  image  plane  P  onto  plane  P3  in 
the  vertical  dimension.  In  the  horizontal  dimension,  Lb 
produces  the  Fourier  transform  of  the  light  exiting  plane  P2. 
The  amplitude  of  the  light  at  the  output  plane  P3  is  mod¬ 
ulated  by 

g’iu.'Y.t)  ~  J  f(<  +  x/v)h(x,y)exp(j0,x)dx  (1) 

where  u,  -  2vx'/\fb  is  the  radial  spatial  frequency,  A  is 
the  wavelength  of  light,  Fb  is  the  focal  length  of  Lb,  and  x' 
is  the  horizontal  coordinate  at  plane  P}  If  a  slit  is  placed  at 
P3,  oriented  vertically  and  centered  on  the  optical  axis,  then 
light  is  transmitted  through  the  slit  only  around  u,  -  0.  The 
width  of  the  slit  is  chosen  to  be  less  than  AFj/A  (A  being 
the  aperture  of  the  mask  at  plane  P2)  and  a  detector  array  is 
placed  immediately  after  the  slit.  The  photocurrent  that 
is  generated  at  a  detector  element  located  at  position  y,  is 
proportional  to 

gO.Y)  ”|/'(f  +  */v)h{x,y)dx  (2) 

The  temporal  modulation  of  the  output  signal  from  each 
detector  is  the  magnitude  squared  of  the  correlation  of  the 
input  signal  f{t)  and  the  signal  that  is  recorded  on  the  mask 
as  a  function  of  position  x  at  the  position  along  the  y 
dimension  where  the  corresponding  detector  element  is 
placed.  The  number  of  parallel  correlations  that  this  system 
can  compute  is  limited  by  the  size  of  the  parallel  readout 
detector  array  that  can  be  fabricated — in  practice  approxi¬ 
mately  100. 

The  multichannel,  time  integrating  spectrum  analyzer  [21) 
shown  in  Fig.  2  is  an  example  of  a  multichannel  system  that 
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Fig.  2.  Multichannel  time  integrating  spectrum  analyzer 
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can  accept  many  signals  in  parallel  and  perform  the  same 
operation  on  each.  A  linear  array  of  LEDs  is  placed  in  the 
input  plane  P \  of  fig.  2.  The  pair  of  cylindrical  lenses  L,  and 
L2  collimate  the  light  from  each  LEO  so  that  they  all 
illuminate  the  AOD  placed  in  plane  P2.  The  focal  length  of 
lens  L,  is  chosen  to  be  much  shorter  than  the  focal  length 
of  L2  so  that  the  beams  illuminating  the  AOD  are  narrow  in 
the  vertical  direction  and  wide  horizontally  matching  the 
shape  of  the  aperture  of  the  AOD.  The  intensity  of  the  mh 
LED  is  modulated  by 

In-  Iq  +  sn(f)cos(uof  +  <>fJ)  (3) 

where  s„(f)  denotes  the  nth  input  signal,  uq  is  a  fixed 
frequency  the  significance  of  which  will  be  discussed 
shortly,  b  is  a  constant  that  has  units  s~2,  and  /0  is  a  bias 
that  is  added  to  each  signal  to  allow  negative  values  to  be 
represented  by  light  intensity.  The  modulating  signal  ap¬ 
plied  to  the  AOD  is  h(t)  -  cos(<jq t  +  b(2).  When  a  bias  is 
added  to  this  signal  before  it  is  applied  to  the  AOD,  the 
intensity  of  the  diffracted  light  is  modulated  proportionally 
to  h(t  -  x/v).  Therefore,  the  intensity  of  the  light  dif¬ 
fracted  by  the  AOD  in  Fig.  2  is  modulated  by  the  product  of 
the  incident  intensity  and  h(t  -  x/v).  The  cylindrical  lens 
1 3  and  the  spherical  lens  L4  form  an  image  of  this  diffracted 
light  in  the  horizontal  (x)  direction  at  the  output  plane  P}. 
The  lens  L4  focuses  the  light  vertically  onto  the  output 
plane  or,  equivalently,  the  combination  of  lenses  L,  and  L4 
produce  an  image  of  the  LED  array  in  the  vertical  direction 
at  the  output  plane  Consequently,  light  that  originates  at 
the  nth  LED  is  detected  on  the  nth  row  of  a  2-D  detector 
array  at  plane  Py  The  photogenerated  charge  on  a  detector 
element  located  at  position  x  at  the  nth  row  of  the  array  is 
proportional  to  the  time  integrated  intensity  of  the  incident 
light: 

/D(x,n )  «•  j ln(t,x)h(t  -  x/v)  dt  +  bias  terms 

-  Js„(f)cos(<*,f  +  bt2) 

•cos  («of  +  b(t  -  x/v)2)  dt  +  bias 
-(1/2)/sn(f) 

■cos(uqx/v  +  2bxt/v  +  bx2/v2)dt  +  bias 

-  (1/2)|5„(2bx/v)| 

•cos  [uqx/v  +  $n(2 fax/v)  +  bx'/v2]  +  bias. 

(4) 

In  the  above  equation 

$,(“)  -  l^.(")|exp[$„(w)]  —  f  s„(t)e~'“'  dt 

is  the  Fourier  transform  of  the  real  signal  s„(t).  Each 
transform  is  recorded  as  a  function  of  position  x  at  a 
different  row  of  the  detector  array  and  therefore  the  spectra 
of  all  input  signals  can  be  independently  accessed.  The 
magnitude  of  each  transform  modulates  the  amplitude  of 
the  spatial  carrier  in  (4)  whereas  the  phase  of  the  transform 
appears  as  phase  modulation  on  the  same  carrier  Both 
quantities  can  be  obtained  directly  when  the  detector  is 
read  out,  by  electronically  filtering  the  detector  signal  to 
remove  the  bias  terms  in  (4)  and  mixing  the  filtered  signal 
with  cos(uqx  +  bx2/v2)  in  quadrature  to  obtain  the  real 


and  imaginary  components  of  5n(“)-  This  Fourier  transform¬ 
ing  algorithm,  known  as  the  "chirp-z"  in  the  digital  signal 
processing  literature  (22),  has  proven  very  useful  in  optics 
since  it  allows  the  calculation  of  the  transform  of  long 
signals  with  fine  resolution,  using  temporal  integration  on 
the  detector.  The  integration  time  is  limited  by  the  dark 
current  of  the  detector  to  several  milliseconds  or  longer  if 
the  detector  is  cooled.  In  general,  the  system  of  Fig  2  can 
be  used  for  the  calculation  of  the  spectra  of  many  relatively 
narrow-band  signals  with  fine  resolution.  The  number  of 
parallel  channels  in  this  case  is  limited  by  the  number  of 
LEDs  (or  laser  diodes)  that  is  feasible  to  assemble  and  drive 
in  parallel.  LD  arrays  have  been  fabricated  monolithically 
with  18  elements  at  15-/im  centers  [23]  and  it  is  feasible  to 
fabricate  larger  arrays  either  monolithically  or  by  stacking 
individual  modules. 

III.  2-D  Processing  of  1-D  Signals 

In  this  section  we  consider  optical  processors  designed  to 
process  1-D  signals  in  both  transverse  spatial  dimensions 
Generally,  more  complex  1-D  signal  processing  operations 
can  be  performed  by  using  the  two  dimensions  directly, 
resulting  in  optical  processors  that  are  not  only  computa¬ 
tionally  more  powerful  than  1-D  processors  (as  are  multi¬ 
channel  systems),  but  also  more  versatile  and  capable  of 
performing  a  wider  class  of  signal  processing  operations.  In 
some  cases  the  distinction  between  multichannel  and  2-D 
processors  is  subtle.  For  instance,  the  multichannel  system 
of  Fig.  1  can  also  be  thought  of  as  processing  its  input  signal 
in  both  spatial  dimensions  to  perform  a  single  linear  opera¬ 
tion.  We  will  see,  however,  through  the  examples  in  this 
section  that  more  direct  utilization  of  the  2-D  space  is 
possible. 

The  first  architecture  considered  is  the  vector-matrix 
multiplier  shown  in  Fig.  3  This  system  demonstrates  the 
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Fig.  3.  Vector-matrix  multiplier,  implemented  with  an  array 
of  LEDs 


impact  that  device  developments  have  had  on  architectural 
design.  The  architecture  in  Fig  3  was  originally  proposed  in 
1%4  [1],  but  the  full  potential  of  this  system  was  appreci¬ 
ated  more  than  10  years  later  [24]— [27],  by  which  time 
broad-band  source  and  detector  arrays  had  become  feasi¬ 
ble  We  examine  here  the  implementation  proposed  by 


PSAITIS  2  0  OPTICAL  PROCtSSING  USING  1-D  INPljl  DfVICtS 


%5 


Goodman  et  at.  [24).  An  array  of  LEDs  is  positioned  verti¬ 
cally  at  the  input  plane  P0  in  Fig.  3.  The  intensity  of  the 
light  emitted  by  the  nth  LED  is  denoted  by  A(n).  The 
spherical  lens  £,  collimates  the  light  from  each  LED  in  the 
horizontal  direction  and  the  combination  of  t,  and  the 
cylindrical  lens  L2  produce  an  image  of  the  LED  array  at 
plane  P2  in  the  vertical  direction.  Consequently,  the  2-D 
mask  placed  at  P2  is  illuminated  uniformly  in  the  horizontal 
direction  and  each  row  of  the  mask  is  illuminated  by  a 
different  LED.  The  intensity  transmittance  of  the  mask  is 
denoted  by  8(n,  m),  which  signifies  that  a  pixel  of  the  mask 
with  area  ( Ox  ■  Dy),  located  at  coordinates  x  -  m  ■  Ox  and 
y  —  n  ■  Oy,  has  average  transmittance  6(n,m).  The  mask  is 
imaged  in  both  dimensions  onto  the  output  plane  P2.  In  the 
horizontal  dimension,  the  spherical  lens  L3  and  the  cylindri¬ 
cal  lens  Lt  produce  a  relatively  large  image  of  the  mask  so 
that  each  column  of  the  mask  is  imaged  onto  a  separate 
element  of  a  linear  detector  array  placed  at  P2.  In  the 
vertical  dimension,  L}  and  i5  produce  a  demagnified  image 
of  the  mask  that  is  smaller  in  the  vertical  direction  than  the 
height  of  each  detector  element.  Therefore,  the  photo- 
generated  signal  ai  the  mih  detector  element  is  propor¬ 
tional  to  the  total  intensity  transmitted  through  the  mth 
column  of  the  mask: 

N 

C(m)  mJ^B(n,m)A(n)  (5) 

n 

where  N  is  the  number  of  LEDs.  The  operation  performed 
in  this  case  is  the  multiplication  of  the  vector  A,  applied  to 
the  LED  array,  and  the  matrix  B,  stored  on  the  mask. 
Equivalently,  it  is  a  1-D  linear  operation  with  a  space-variant 
kernel  The  use  of  the  second  dimension  of  the  optical 
system  provides  in  this  architecture  the  capability  to  per¬ 
form  a  wider  class  of  operations,  since  it  is  only  possible  to 
implement  shift-invariant  operations  and  the  Fourier  trans¬ 
form  with  1-D  systems  It  is  interesting  to  calculate  the 
processing  power  of  this  relatively  simple  optical  processor. 
The  size  of  the  vector  and  the  matrix  that  can  be  processed 
is  limited  by  the  number  of  elements  in  the  LED  and 
detector  arrays.  For  arrays  with  100  elements,  10<  analog 
multiplications  are  performed  by  the  optical  system  each 
time  a  new  vector  is  entered  and  the  product  read  out  by 
the  detector.  If  the  LEDs  and  the  detectors  have  a  10-ns 
response  time,  the  resulting  processing  rate  is  1012  analog 
multiplications  per  second.  The  fact  that  this  large  process¬ 
ing  power  can  be  obtained  with  such  a  simple  optical 
system,  with  which  computations  can  be  performed  with 
relatively  high  accuracy,  has  raised  the  possibility  of  per¬ 
forming  numerical  operations  optically. 

Vector-matrix  products  can  also  be  formed  with  the 
architecture  shown  in  Fig.  4  that  has  been  proposed  by 
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Fig.  4.  Vector-matrix  multiplier,  implemented  with  a  single 
UD  and  a  2-D  CCD  detector 


Monahan  et  at  [28].  In  this  case  a  single  LED  is  used  that  is 
collimated  by  a  spherical  lens  to  uniformly  illuminate  a  2-D 
transparency  with  intensity  transmittance  8(n,m),  where  n 
and  m  are  integers  denoting  the  position  of  each  pixel  of 
the  mask  in  the  two  spatial  dimensions  The  intensity  of  the 
LED  is  successively  modulated  by  the  elements  of  the 
vector  A(i),  where  /  is  an  integer.  The  intensity  of  the  light 
transmitted  through  the  mask  is  modulated  by  the  product 
A(i)B(n,m).  The  light  is  detected  by  a  2-D  CCD  array 
placed  immediately  after  the  mask.  There  is  a  one-to-one 
correspondence  between  the  pixels  of  the  mask  and  the 
detector  elements  of  the  CCD  and  therefore  the  charge  that 
is  photogenerated  at  the  (n,  m)  detector  ele'ment  when  the 
r'th  element  of  the  input  vector  is  applied  to  the  LED  is 
C(n,m,i )  —  A(i)B(n,m).  The  charge  pattern  stored  in  the 
CCD  is  transferred  vertically  by  one  pixel  before  the  next 
element  of  the  vector  is  applied  to  the  LED  The  charge  that 
is  photogenerated  during  the  time  the  LED  is  modulated  by 
the  r'th  element  of  the  input  vector  is  transferred  on  the 
CCD  by  N  —  i  pixels,  in  the  vertical  direction,  after  all  N 
elements  of  the  input  vector  have  been  entered  in  the 
processor.  The  total  charge  that  is  accumulated  on  the  CCD 
after  the  N  elements  of  the  vector  are  applied  to  the  LED,  is 

N 

C(n,m)  -  £fi(n  -  N  +  i,m)A(i).  (6) 

I 

The  CCD  has  n  rows  in  the  vertical  direction  and  the  top 
(Nth)  row  is  a  CCD  register  that  transfers  its  contents 
horizontally  to  the  output  port  of  the  device.  The  charge 
accumulated  at  the  top  row  is  therefore  the  output  signal  of 
this  processor  and  it  is  found  by  substituting  n  -  N  in  (6) 

N 

C(N.m)-Y.B(i.m)A(i).  (7) 

f 

Thus  this  system  also  produces  at  its  output  the  product  of 
the  vector  that  modulates  sequentially  the  intensity  of  the 
LED  and  the  matrix  stored  in  the  mask.  This  example  dem¬ 
onstrates  how  the  same  basic  operation  can  be  performed 
in  different  ways  in  a  2-D  processor,  each  having  distinct 
operational  characteristics.  The  single  LED  and  the  2-D 
detector  array  used  in  this  architecture  allow  serial  loading 
of  data  in  the  optical  system,  a  convenient  property  in  many 
applications.  The  parallel  addressing  of  the  system  in  Fig.  3, 
on  the  other  hand,  is  useful  in  applications  where  the  data 
naturally  appear  in  parallel  format,  such  as  in  processing 
signals  from  antenna  arrays.  Furthermore,  the  parallel  in¬ 
put/output  format  of  the  system  in  Fig.  3  permits  the 
implementation  of  iterative  algorithms  by  feeding  back  the 
output  signal  from  each  detector  element  to  the  corre¬ 
sponding  LED  at  the  input  plane  of  the  processor  [29). 

Both  architectures  discussed  thus  far  in  this  section  re¬ 
quire  a  2-D  transparency  in  addition  to  the  input  devices 
that  are  used  to  enter  broad-band  signals  into  the  optical 
processor.  This  2-D  transparency  is  typically  photographic 
film  on  which  the  matrix  is  permanently  stored.  Conse¬ 
quently,  the  matrix  cannot  be  dynamically  changed  'a  2-D 
transparency  is  not,  however,  the  only  method  that  pro¬ 
vides  access  to  the  2-D  space  of  the  optical  system  2-D 
optical  processors  with  dynamic  spatial  impulse  response 
can  be  implemented  using  two  1-D  modulators  oriented 
perpendicular  to  one  another  The  first  architecture  of  this 
type  was  reported  by  Said  and  Cooper  [30]  The  processor 
shown  schematically  in  Fig  5  is  a  modified  version  of  the 
system  that  was  originally  proposed,  in  that  two  separate 
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fig.  5.  Space  integrating  ambiguity  function  processor 


AODs  are  used  here  in  place  of  a  single  device  with  two 
acoustic  waves  propagating  in  orthogonal  directions.  The 
monochromatic  plane  wave  illuminating  this  system  is 
focused  in  the  vertical  dimension  by  the  cylindrical  lens  f, 
onto  an  AOD  placed  in  the  horizontal  (x)  direction.  A 
signal  f(f)  is  applied  to  the  AOD  and  the  light  diffracted  by 
the  device  is  recollimated  vertically  and  focused  horizon¬ 
tally  by  the  spherical  lens  f2  onto  plane  P,  where  a  second 
AOD  is  placed  oriented  in  the  vertical  (y)  dimension.  This 
AOD  is  driven  by  the  signal  h(t).  In  the  horizontal  dimen¬ 
sion,  the  doubly  diffracted  light  is  collimated  by  the  spheri¬ 
cal  lens  L «  and  the  combination  of  lenses  L2  and  LA  form 
an  image  of  the  light  diffracted  from  the  first  AOD  at  plane 
P2  In  the  vertical  direction,  the  cylindrical  lenses  f3  and  LA 
form  the  image  of  the  light  diffracted  by  the  second  AOD 
at  P2.  The  amplitude  of  the  2-D  light  distribution  at  P2  is 
therefore  modulated  by  F(f-  x/v)h(t  -  y/v).  The  astig¬ 
matic  pair  of  lenses  i5  and  Lb  image  P2  along  one  dimen¬ 
sion  and  form  the  Fourie.  transform  in  the  orthogonal 
dimension.  The  direction  in  which  the  cylindrical  lens  i5 
has  focusing  power  is  at  45°  with  respect  to  the  x  and  y 
axes  and  therefore  the  Fourier  transformation  is  performed 
along  a  direction  that  is  also  at  45°  with  respect  to  the  (x,  y) 
axes  It  is  convenient  at  this  point  to  define  a  new  set  of 
coordinates,  y' .  parallel  to  the  axis  of  the  cylinder  t5  and  x' 
perpendicular  to  y' .  The  old  coordinates  are  related  to  the 
new  by 


x'  -  (x  +  y)/fi 

(*-  y)/V2. 

We  can  now  readily  write  an  expression  for  the  amplitude 
of  the  light  distribution  at  the  output  plane  P,  as  the  1-D 
Fourier  transform  of  the  light  distribution  at  plane  P2 

g(u,y',t)  -  j t[  t  ~(x'  +  y')/Jlv\  h[r  -(x'  -  y')/y7v] 

■exp  (2  wx'u)dx'  (8) 

where  u  -  x"/\Fb,  x"  is  the  spatial  coordinate  at  the  out¬ 
put  plane  and  fb  is  the  focal  length  of  Lb.  The  function  g  in 
the  above  equation  has  some  interesting  properties  If  f(t) 
-  h(  t  -  T)exp(/2iV)  is  a  delayed  version  of  the  signal 
h(t),  shifted  in  frequency  by  hertz,  then  at  x" - 
Uv\Fb/  /2  v  and  at  a  time  t  when  both  f  and  h  are  within 
the  apertures  of  the  AODs,  g  as  a  function  of  position  y'  is 
the  autocorrelation  of  h  The  peak  of  this  autocorrelation 
♦unction  occurs  at  y'  •»  vr/4l  This  operation,  known  as 
the  ambiguity  function  [31],  is  useful  n  radar  signal  p  ocess- 
ing  since  the  range  (which  is  proportional  to  rl  and  the 
velocity  of  a  target  (proportional  to  Uq)  can  be  estimated 
from  the  location  of  the  peak  of  g  in  the  (u,  y')  plane  If  the 
signals  (  and  h  are  longer  than  the  acoustic  delay  through 
the  AODs,  the  ambiguity  function  of  a-ditferent  portion  of 
the  two  signals  is  calculated  at  any  one  time  These  partial 


ambiguity  surfaces  can  be  incoherently  accumulated  in 
time  on  a  2-D  detector  at  the  output  plane  to  enhance  the 
signal-to-noise  ratio.  This  architecture  exemplifies  the  dis¬ 
tinction  between  multichannel  and  2-D  processors  The 
operation  performed  along  either  of  the  two  spatial  coordi¬ 
nates  is  not  independently  part  of  the  final  answer,  only  the 
combined  processing  along  both  transverse  dimensions 
produces  the  full  ambiguity  surface. 

The  system  described  above  is  interesting  in  its  own 
right,  but  perhaps  more  importantly  it  demonstrated  for  the 
first  time  a  very  flexible  and  powerful  method  for  process¬ 
ing  data  in  two  dimensions:  the  use  of  two  orthogonal 
AODs  or  other  1-D  devices.  In  recent  years,  many  config¬ 
urations  have  been  proposed  using  this  technique  [32)-[36] 
and  it  is  likely  that  more  architectures  of  this  type  will  be 
invented  We  will  examine  here,  as  an  additional  example,  a 
particularly  flexible  architecture  proposed  by  Kellman  [37] 
and  Turpin  [38]  and  shown  in  Fig.  6  A  LED  is  the  light 
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Fig.  6.  Time  integrating  triple -product  processor 


source  in  this  system,  its  intensity  temporally  modulated  by 
the  signal  a(f)  The  first  AOD,  oriented  horizontally  in  Fig 
6,  is  modulated  by  the  signal  b(t)  and  illuminated  b\  the 
LED  through  lenses  L,  and  L  The  intensity  of  the  light 
diffracted  by  the  AOD,  modulated  by  the  product  a(t)b(r 
-  x/v).  is  expanded  vertically  and  focused  horizontally  by 
L  j  to  illuminate  the  second,  vertically  oriented  AOD  in  Fig 
6  The  signal  applied  to  the  second  AOD  is  denoted  b\ 
c(f)  The  doubly  diffracted  light  is  modulated  by  the  prod 
uct  a(  t)b(t  -  x/v)c{  f  -  y/v)  The  cylindrical  lenses  L  A  and 
Lt  produce  an  image  of  the  second  AOD  in  the  vertical 
direction  at  the  output  plane,  while  f3  and  image  the 
first  AOD  in  the  horizontal  direction  onto  the  output  plane 
A  2-D  detector  array  is  placed  at  the  output  plane  The 
photogenerated  charge  that  accumulates  at  a  detector  ele- 
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ment  located  at  coordinates  (x,  y)  and  exposed  to  light  for 
r seconds  is  proportional  to 

d(x,y )-  /  a(t)b(t  -  x/v)c(t  -  y/v)dt.  (9) 

This  system  is  known  as  the  triple  product  processor  be¬ 
cause  the  2-D  output  function,  d(x,y),  is  obtained  by 
temporally  integrating  the  product  of  the  three  input  sig¬ 
nals.  We  can  see  from  the  top  and  side  views  in  Fig.  6  that 
this  processor  consists  of  two  1-D  time  integrating  correla¬ 
tors,  operating  simultaneously  in  orthogonal  directions. 
Note  the  difference  between  this  system  and  the  multi¬ 
channel  time  integrating  processor  we  discussed  in  the 
previous  section  (Fig.  2).  A  correlation  is  performed  in  this 
case  in  both  dimensions;  the  result  is  obtained  from  the 
combined  2-D  processing  rather  than  the  repetition  of  the 
1-D  processing  operation.  The  operation  performed  by  this 
architecture  always  has  the  general  form  given  by  (9),  but 
there  is  considerable  flexibility  since  all  three  input  signals 
are  electronic:  by  altering  them  new  operations  can  be 
performed  with  the  same  optical  hardware.  For  instance,  if 
a(f)-  s(f)exp(/*H),  b(t)-s(t),  and  c(f)  -  exp(-jkt2), 
where  k  is  a  constant,  then  the  output,  d(x,  y)  becomes 

d(x,y)  -  exp[-/7c(y/v)2]  fs(t)s(t-  x/v) 

•exp  [-2  j(ky/v)t]dt.  (10) 

The  above  expression  is  the  ambiguity  function  of  the 
signal  s(f)  multiplied  by  a  quadratic  phase  term  (which  can 
be  removed,  if  necessary,  by  post-detection  multiplication). 
Notice  that  in  (10)  we  have  allowed  the  input  signals  to  be 
complex.  In  practice,  complex  signal  processing  capability  is 
achieved  by  modulating  in  quadrature  an  offset  carrier  with 
the  input  signals  and  adding  a  bias  to  the  modulated  carrier, 
before  the  signals  are  applied  to  the  AODs  of  the  processor. 

A  different  signal  processing  operation  can  be  performed 
with  the  system  of  Fig.  6,  if  we  set  a(f)  -  s(t)exp(jk,t2  + 
jk2t2),  b(t)  ”  exp(-/'k,f2),  and  c(f)  -  exp(-y*2f2)  (39], 
The  output  in  this  case  takes  the  following  form: 

d(x.y)  -  exp [ -jk^(x/v)2  -  jk2(y/v)2] 

fs(t)exp[-j{2k,x/v)t]exp[-j(2k2y/v)t]dt. 


If  we  neglect  the  multiplicative  quadratic  phase  term,  d(x,  y) 
is  the  Fourier  transform  of  the  signal  s(f),  calculated  via  the 
chirp-z  algorithm,  in  both  spatial  dimensions.  The  spectrum 
is  displayed  in  both  dimensions  as  a  function  of  position 
with  k,x/2w v  and  k2y/2irv  being  the  frequency  variables 
in  the  x  and  y  directions,  respectively.  The  maximum 
frequency  of  s(f)  for  which  the  spectrum  is  calculated  in 
the  x  and  y  dimensions  is  k,A/2irvand  k:A/2irv,  respec¬ 
tively,  where  A  is  the  aperture  of  both  AODs  in  Fig  7  (i.e,, 
the  maximum  value  for  x  and  y)  The  frequency  resolution 
is  equal  to  the  maximum  frequency  divided  by  the  number 
of  pixels  in  each  dimension  of  the  2-D  detector  array  or  the 
space-bandwidth  product  of  the  AODs,  whichever  is 
smaller  If  k,  is  chosen  so  that  k,A/ 2nv  is  equal  to  the 
bandwidth  8  of  s(f),  then  the  entire  spectrum  of  s(f)  is 
displayed  in  the  x  direction  with  relatively  low  resolution 
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Fig.  7.  Triple-correlator  architecture. 

If  kl  is  chosen  to  be  equal  to  k ^  divided  by  the  number  of 
pixels  of  the  detector  (let  us  take  this  number  to  be  103), 
then  only  1/103  of  the  spectrum  is  displayed  in  the  y 
direction  at  each  position  x.  The  resolution  in  the  y  dimen¬ 
sion  is  then  equal  to  the  bandwidth  of  s(f)  divided  by  I0b, 
assuming  that  the  integration  time,  T,  on  the  detector  is  at 
least  10 b/8  seconds.  The  combination  of  the  broad-band, 
low-resolution  transform  in  x  and  the  high-resolution, 
low-bandwidth  transform  in  y  produces  the  2-D  "folded" 
spectrum  or,  equivalently,  the  2-D  raster  recording  of  10b 
samples  of  the  1-D  Fourier  transform  of  the  signal  s(f).  The 
formation  of  the  1-D  spectrum  in  two  spatial  coordinates 
with  this  architecture,  allows  the  display  of  10fc  spectral 
samples  since  2-D  detector  arrays  of  this  size  are  available, 
whereas  the  size  of  1-D  detector  arrays  is  on  the  order  of 
103.  The  triple-product  processor  can  also  be  used  to  calcu¬ 
late  the  "folded"  correlation  of  1-D  signals  longer  than  the 
acoustic  delay  of  the  AODs  used  in  the  implementation. 
This  is  possible  for  signals  that  can  be  written  as  the 
product  of  two  shorter  codes  140).  The  advantage  of  the 
folded  correlation  over  a  1-D  implementation  is  that  two 
very  long  signals  can  be  correlated  and  at  the  same  time 
long  differential  delays  between  the  two  signals  are  per¬ 
mitted.  Either  one  of  these  properties  can  be  achieved  with 
a  1-D  implementation,  but  they  can  be  obtained  simulta¬ 
neously  only  with  the  2-D  implementation. 

The  product  of  two  matrices  can  also  be  computed  by 
this  same  architecture  using  the  method  described  by  Athale 
ef  at.  (41).  This  is  accomplished  by  applying  the  columns  of 
the  first  matrix  sequentially  to  the  first  AOD  in  Fig.  6  while 
the  rows  of  the  second  matrix  are  applied  to  the  second 
AOD.  At  periodic  time  instances,  when  the  acoustic  signals 
in  the  two  AODs  correspond  to  one  complete  column  and 
row  of  the  matrices,  the  LED  is  pulsed  and  the  outer 
product  between  the  two  vectors  is  formed  and  detected  at 
the  output  plane  of  the  system.  The  accumulation  on  the 
2-D  detector  of  the  outer  products  of  all  the  columns  of  the 
first  matrix  with  the  corresponding  rows  of  the  second 
matrix,  results  in  the  formation  of  the  product  matsix.  In  the 
vector-matrix  multipliers  we  considered  earlier  (Figs.  3  and 
4)  both  spatial  dimensions  are  used  to  perform  an  operation 
simpler  than  the  product  of  two  matrices.  The  reason  it  is 
possible  to  perform  directly  more  complex  operations  with 
the  triple-product  processor  is  that  the  detector  is  used  to 
store  and  accumulate  partial  results,  i.e.,  data  are  processed 
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in  the  time  domain  in  addition  to  the  two  spatial  coordi¬ 
nates.  Interestingly,  however,  the  triple-product  processor 
that  forms  the  matrix-matrix  product  is  less  powerful  than 
the  vector-matrix  multiplier  of  Fig.  3.  A  matrix-matrix  prod¬ 
uct  can  be  performed  with  the  system  of  Fig.  3  by  repetitive 
vector-matrix  multiplications  (inner  products).  The  number 
of  inner  products  that  must  be  computed  with  this  ap¬ 
proach  is  equal  to  the  number  of  outer  products  that  must 
be  computed  with  the  triple-product  processor.  The  vec¬ 
tor-matrix  multiplication  is  computed  by  the  system  of  Fig. 
3  in  a  time  equal  to  the  inverse  of  the  modulation  band¬ 
width  of  the  L£Os,  which  can  be  10  ns  or  less.  The  outer 
product  is  computed  in  the  system  of  Fig.  7  in  the  time  it 
takes  to  load  the  AODs,  typically  1  /ts  or  more  Thus  the 
simpler  system  of  Fig.  3  has  the  speed  advantage.  This  is  a 
consequence  of  the  high  degree  of  parallelism  at  the  input 
and  output  stages  of  this  processor,  a  feature  however  that 
in  practice  is  not  desirable  because  of  the  need  to  handle 
electronically  many  parallel  broad-band  channels.  This 
tradeoff  between  speed  and  parallelism  at  the  input  and 
output  stages  of  the  optical  system  is  frequently  encoun¬ 
tered  in  the  design  of  optical  processing  systems. 

We  now  discuss  an  architecture  in  which  the  2-D  space  is 
ingeniously  used  to  perform  the  correlation  of  three  1-D 
signals.  The  triple  correlation  is  equivalent  in  the  frequency 
domain  to  the  product  of  the  1-D  transforms  of  the  three 
signals  All  three  transforms  can  be  produced  with  1-D 
optical  systems  (Fourier  transforming  lenses)  but  only  dou¬ 
ble  products  of  these  transforms  are  produced  in  one  di¬ 
mension  by  detecting  their  interference.  The  triple  product 
of  the  transforms  can  be  formed  if  both  transverse  dimen¬ 
sions  of  the  optical  system  are  used,  with  the  processor 
shown  in  Fig.  7.  This  system  is  a  simplified  version  of  an 
architecture  proposed  by  Vander  Lugt  [42].  The  first  func¬ 
tion,  f(  y),  is  recorded  as  a  1  -D  transparency  in  the  vertical 
direction,  and  it  is  imaged  through  a  second  horizontal 
transparency  whose  transmittance  is  the  second  function, 
h(x)  The  amplitude  of  the  light  following  the  second 
transparency  is  modulated  by  the  product  f{y)h(x).  A 
spherical  lens  forms  the  2-D  Fourier  transform  of  this  prod¬ 
uct  and  produces  at  the  output  plane  of  the  system  in  Fig 
7(a)  a  light  distribution  whose  amplitude  is  modulated  by 
the  product  f(  v)H(u).  f  and  H  are  the  transforms  of  f  and 
h,  respectively,  and  v  and  u  are  the  spatial  frequency 
variables  at  the  output  plane.  If  the  (u,  v)  coordinates  are 
rotated  by  45°  to  obtain  the  new  coordinates  u'  -  (u  + 
v)//2,  v'-(u-  v)//2.  the  field  at  the  output  plane 
takes  the  form  f[(u'  -  v')/  /2  ]H((  u‘  +  v')/  /2  ]  At  v'  -  0 
the  amplitude  of  the  field  is  modulated  along  the  u'  direc¬ 
tion  by  the  product  of  the  two  transforms.  The  product  of 
the  three  transforms  can  now  be  formed  by  detecting  the 
interference  of  this  pattern  and  the  transform  of  the  third 
signal  The  third  transform  is  produced  in  a  separate  portion 
of  the  system,  shown  in  Fig.  7(b).  A  1-D  transparency  of  the 
third  signal,  g(x'),  is  recorded  in  a  direction  that  is  at  45° 
with  the  ( x,  y)  axes  and  parallel  to  the  u'  axis.  The  focal 
length  of  the  Fourier  transforming  lens  in  Fig.  7(b)  is  v/2 
times  longer  than  the  one  in  Fig.  7(a)  to  compensate  for  the 
scaling  that  occurs  from  observing  the  spectra  along  the 
diagonal  in  Fig  7(a).  When  the  interference  of  the  output 
light  from  the  two  systems  in  Fig.  7(a)  and  (b)  is  detected 
along  the  u'  axis,  one  of  the  terms  in  the  interference 
pattern  consists  of  the  product  of  the  three  transforms.  The 


triple  correlation  can  now  be  formed  by  inverse  Fourier 
transforming  this  term.  In  Vander  Lugt's  implementation  all 
three  transparencies  are  implemented  with  AODs.  There¬ 
fore,  there  is  a  proportional  temporal  frequency  shift  at 
each  spatial  frequency  and  this  makes  it  possible  to  obtain 
the  inverse  transform  as  the  temporal  signal  at  the  output  of 
a  detector  that  integrates  all  the  light  along  the  u'  axis.  The 
particularly  interesting  feature  of  this  architecture  is  the  use 
of  three  AODs  oriented  in  three  separate  directions.  The 
use  of  more  than  two  1-0  devices  in  nonperpendicular 
directions  is  the  possibility  that  is  only  beginning  to  be 
explored  and  will  likely  result  in  new  2-D  architectures  in 
the  future. 

The  systems  that  have  been  discussed  here  are  only  a 
portion  of  the  possible  2-D  architectures  for  processing  1-D 
signals,  but  through  these  examples  it  becomes  apparent 
that  the  2-D  space  provides  not  only  additional  processing 
power  but  also  versatility.  A  much  broader  class  of  linear 
operations  can  be  performed  on  1-D  signals  with  a  2-D 
processor  and  each  operation  can  usually  be  performed  in 
several  different  ways.  The  latitude  in  the  design  allows  the 
optimization  of  the  architecture  to  obtain  the  most  suitable 
characteristics  (input/output  format,  programmability,  proc¬ 
essing  power)  for  each  application. 


iv.  Processing  oe  2-D  Signals 

It  was  stated  in  the  Introduction  of  this  paper  that  the 
2-D  processing  capability  of  optics  makes  this  technology 
particularly  well  suited  for  image  processing  applications. 
2-D  linear  operations  such  as  the  Fourier  transform  and 
correlation  can  be  directly  performed  optically  if  the  input 
image  is  recorded  as  a  2-D  transparency.  When  the  processor 
is  implemented  with  1-D  input  devices,  we  are  faced  with 
the  problem  that  the  entire  image  cannot  be  entered 
simultaneously  in  the  optical  processor.  Typically,  images 
with  106  pixels  are  processed,  whereas  the  space-band¬ 
width  product  of  1-D  devices  is  limited  to  approximately 
103  One  possible  solution  to  this  problem  is  the  segmenta¬ 
tion  of  the  image  processing  operation  into  smaller  tasks, 
each  one  of  which  is  implementable  with  an  optical  system 
that  uses  1-D  input  devices.  The  partial  results  can  then  be 
stored  electronically  in  order  to  synthesize  the  final  result 
when  all  the  subtasks  are  completed  by  the  optical 
processor.  Such  an  approach  is  indeed  possible  and  feasi¬ 
ble.  In  many  instances,  however,  it  is  not  only  the  process¬ 
ing  power  that  makes  the  optical  implementation  attractive, 
but  equally  important,  its  low  power  requirement,  size,  and 
cost.  The  use  of  the  large,  high-speed  electronic  memory 
that  is  needed  in  this  approach  can  eliminate  these  ad¬ 
vantages.  The  need  for  an  external  memory  can  be  avoided 
by  using  the  detector  of  the  optical  system  as  the  memory 
in  which  the  partial  results  are  temporarily  stored.  The 
partial  results  can  be  computed  by  spatial  integration  in  the 
optical  system  and  accumulated  through  temporal  integra¬ 
tion  on  the  detector  to  produce  the  final  result.  A  2-D 
space  can  be  constructed,  in  this  manner,  from  one  spatial 
dimension  and  time,  in  which  an  image  can  be  represented 
and  processed  optically  by  temporal  and  spatial  integration 
(T5I).  Alternatively,  the  partial  results  can  be  computed  with 
a  time  integrating  optical  processor,  and  thus  a  purely  time 
integrating  optical  image  processor  can  be  implemented  In 
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either  case,  the  use  of  the  2*0  optical  system  is  essential, 
since  the  image  must  be  processed  in  each  of  its  dimen¬ 
sions  along  a  separate  axis  of  the  optical  system. 

TSI  processing  was  originally  proposed  by  Bader  [43]  and 
Psaltis  and  Casasent  [44]  for  spectrum  analysis  of  1-0  sig¬ 
nals.  The  spectrum  of  1-D  signals  can  be  optically  com¬ 
puted  with  a  1-0  space  or  time  integrating  acoustooptic 
spectrum  analyzer.  The  two  implementations  have  comple¬ 
mentary  characteristics:  the  space  integrating  implementa¬ 
tion  provides  wide  bandwidth  but  relatively  low  resolution, 
whereas  the  time  integrating  system  can  produce  a  high 
resolution  spectrum  over  a  relatively  small  bandwidth.  A 
high-bandwidth,  high-resolution  spectrum  can  be  produced 
with  a  2-D  optical  processor  using  a  combination  of  tem¬ 
poral  and  spatial  integration.  The  space  integrating  spec¬ 
trum  analyzer  is  shown  in  Fig.  0(a).  If  the  signal  that  is 
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Fig- 8.  Time  and  space  integrating  spectrum  analyzer 

applied  to  the  AOD  is  denoted  by  f(  t ),  then  the  amplitude 
of  the  light  at  the  back  focal  plane  of  the  Fourier  transform¬ 
ing  lens  is  modulated  by 

«(*'.  0  -  [  f(  t  ~  x/v)  exp  (jlirux)  dx 
Jx 

-  {  F(  vu)» sine  (Xvu)}  exp  (~j2nvut).  (12) 

X  in  the  above  equation  is  the  aperture  of  the  AOD, 
u  -  x'/Af  is  the  spatial  frequency  variable,  x'  is  the  spatial 
coordinate  at  the  output  plane.  F  is  the  focal  length  of  the 
lens,  and  •  denotes  convolution.  The  spatial  modulation  at 
the  output  is  the  Fourier  transform  of  f(  t ),  F(  vu),  smoothed 
by  the  convolution  with  4  sine  function  due  to  the  finite 
aperture  of  the  AOD.  The  frequency  resolution  is  limited  by 
the  width  of  the  main  lobe  of  the  sine  function  and  it  is 
equal  to  v/X  hertz.  The  amplitude  of  the  output  light  is 
also  temporally  modulated  sinusoidally  at  each  spatial 
frequency  location  at  a  temporal  frequency  proportional  to 
the  spatial  frequency  u.  If  we  consider  all  the  light  incident 
on  a  single  spatial  frequency  resolution  cell  (with  spatial 
width  A  F/X),  then  the  bandwidth  of  the  temporal  modu¬ 
lation  of  this  light  is  only  v/X,  equal  to  the  frequency 
resolution  of  the  space  integrating  processor  We  can  there¬ 
fore  use  this  temporally  modulated  light  as  an  input  to  a 
chirp-z,  time  integrating  processor  operating  in  the  or¬ 
thogonal  dimension  (Fig  8(b))  and  thus  produce  a  high-res- 
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olution  spectrum  of  the  narrow-band  temporal  signal  local¬ 
ized  at  each  resolution  element  of  the  space  integrating 
processor.  All  the  coarse  resolution  elements  can  be  simul¬ 
taneously  processed  by  a  single  multiplexed  time  integrat¬ 
ing  spectrum  analyzer,  as  we  discussed  earlier  (Fig.  2).  The 
temporal  bandwidth  of  the  light  within  every  one  of  the 
spatial  frequency  resolution  cells  is  the  same  ( v/X),  but  the 
center  frequency  of  the  temporal  modulation  at  each  posi¬ 
tion  is  nv/X,  where  n  is  an  integer  that  increases  in  propor¬ 
tion  to  the  position  of  the  resolution  cells  of  the  space 
integrating  system.  The  signals  from  all  cells  must  be  het¬ 
erodyned  to  baseband  before  they  can  be  simultaneously 
processed  by  the  multichannel  time  integrating  correlator. 
A  pulsed  light  source  with  pulse  repetition  frequency  v/X. 
can  be  used  to  accomplish  this  function.  If  the  individual 
pulses  are  sufficiently  narrow,  the  temporal  modulation  of 
the  light  source  can  be  approximated  by  a  series  of  delta 
functions 

mX/v)-  (v/X)£exp[(/mv/X)f]  (13) 

m  m 

The  amplitude  of  the  light  at  the  output  of  the  space 
integrating  system  is  modulated  by  the  product  of  (12)  and 
(13).  We  see  from  (13)  that  the  periodic  pulse  waveform  of 
the  light  source  produces  all  the  harmonics  of  the  temporal 
frequency  v/X.  Therefore,  at  the  nth  resolution  cell,  the 
center  frequency  nv/X  of  the  modulation  will  be  mixed 
with  the  nth  harmonic  of  the  source  to  produce  a  temporal 
signal  at  baseband.  Since  this  happens  for  all  n,  there  is  a 
baseband  signal  at  each  resolution  cell.  The  multichannel 
time  integrating  processor  produces  the  fine  frequency 
transform  from  the  baseband  signal  in  each  channel  while  it 
averages  to  zero  all  nonbaseband  signals  and  forms  on  the 
2-D  detector  array  at  the  output  of  the  time  integrating 
system  the  folded  spectrum  of  f(t). 

TSI  processors  have  been  applied  to  other  1-D  signal 
processing  problems  such  as  the  computation  of  the  corre¬ 
lation  of  long  1-D  signals  and  ambiguity  functions  [45J— [47]. 
The  architecture  that  produces  the  folded  spectrum  of  a 

1- D  signal  is  of  particular  interest  to  this  discussion,  how¬ 
ever,  because  it  suggests  a  methodology  for  using  TSI  to  do 
image  processing.  The  folded  spectrum  was  first  discussed 
in  the  context  of  optical  signal  processing  by  Thomas  [48], 
who  showed  that  if  a  long  1-D  signal  is  raster  recorded  as  a 

2- D  transparency,  then  the  2-D  Fourier  transform  of  this 
transparency  is  the  raster  recording  of  the  transform  of  the 
original  1-D  signal  (i.e.,  the  folded  spectrum).  Thomas' 
result  can  be  applied,  in  reverse,  to  the  TSI  processor:  the 
folded  spectrum  produced  by  the  TSI  processor  can  be 
interpreted  as  the  2-D  Fourier  transform  of  the  image  that 
forms  by  raster  recording  the  1-D  input  signal  Each  hori¬ 
zontal  line  of  this  image  corresponds  to  a  portion  of  the 
1-D  input  signal,  with  duration  equal  to  the  acoustic  delay 
through  the  aperture  of  the  AOD  The  2-D  Fourier  trans¬ 
form  of  an  image  can  be  computed  with  the  system  of  Fig 
8,  by  using  a  TV  camera  to  detect  the  image  and  setting  the 
duration  of  each  horizontal  video  line  equal  to  the  acoustic 
delay  of  the  input  AOD  The  video  from  the  TV  camera  is 
applied  as  the  1-D  input  signal  to  the  processor  and  the  2-D 
Fourier  transform  of  the  image  forms  on  the  2-D  detector  at 
the  output  plane  in  Fig.  8.  Notice  that  the  pulse  repetition 
frequency  of  the  light  source  of  the  system  in  Fig  8  is  equal 
to  the  inverse  of  the  acoustic  delay.  An  alternate  interpreta- 
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tion  of  the  image  transforming  TSI  processor  is  as  follows: 
each  line  of  the  input  image  is  scanned  by  the  TV  camera 
and  entered  in  the  AOO;  the  light  source  is  pulsed  to  read 
out  the  current  video  line  which  is  transformed  by  spatial 
integration  with  the  lens;  the  different  lines  of  the  image 
are  sequentially  scanned  and  entered  into  the  optical  sys¬ 
tem  where  the  Fourier  transform  along  the  second  dimen¬ 
sion  of  the  image  is  produced  by  temporal  integration  in 
the  second  dimension  of  the  optical  processor. 

The  TSI  processing  concept  can  be  applied  to  a  more 
general  class  of  image  processing  operations.  Specifically,  it 
is  possible  to  realize  any  2-D  linear  operation  that  has  a 
kernel  separable  in  the  two  dimensions  or  shift  invariant 
operations.  2-D  linear  operations  with  separable,  but  other¬ 
wise  arbitrary  kernel,  can  be  implemented  with  the 
processor  shown  in  Fig.  9  (49].  The  input  image  is  denoted 


Fig.  9.  Time  and  space  mtegraling  image  processor,  for  the 
implementation  of  linear  operations  with  space-variant,  sep¬ 
arable  kernel 


by  f(x,n),  where  x  is  a  continuous  variable  along  one  of 
the  dimensions  and  n  is  an  integer  that  enumerates  the 
lines  along  the  second  dimension.  A  TV  camera  is  used  to 
scan  sequentially  the  lines  of  the  image  f(x,  n),  and  the 
video  is  applied  to  the  first  AOD  in  Fig.  9.  The  light  source 
is  pulsed  periodically  to  read  out  separately  each  line  from 
the  AOD.  The  light  diffracted  by  the  AOD  is  imaged  in  the 
horizontal  ( x )  direction  and  expanded  uniformly  in  the 
vertical  direction  to  illqminate  a  mask  placed  in  plane  P2 
with  transmittance  h,(x.y)  The  light  transmitted  through 
this  transparency  is  imaged  in  the  horizontal  direction,  by 
the  lenses  L,  and  t5„onto  a  second  AOD  that  is  oriented 
horizontally  as  well  A  slit  is  placed  at  the  focal  plane  of 
lens  L  i  that  blocks  high  spatial  frequency  components  in 
the  x  direction.  If  the  slit  is  sufficiently  narrow  (approxi¬ 
mately  equal  to  the  width  of  one  resolution  spot),  then  the 
image  at  P}  is  spatially  integrated  along  the  x  direction  The 
second  AOD  is  modulated  by  the  video  signal  from  a 
second  TV  camera,  which  is  pointed  at  an  image  h2(n,x'). 
x'  is  the  horizontal  coordinate  at  the  plane  of  the  second 
AOD,  and  n  indicates  the  line  number  of  the  second  image 
The  two  cameras  operate  in  synchronism,  so  that  the  acous¬ 
tic  signal  in  the  second  AOD  is  the  nth  line  of  the  image  h t 
at  the  instant  the  signal  in  the  first  AOD  is  the  nth  line  of 


the  input  image  1.  The  light  diffracted  by  the  second  AOD 
is  imaged  horizontally  by  lenses  Lb  and  L?  to  the  output 
plane,  where  a  2-D  detector  array  is  placed.  In  the  vertical 
direction,  the  light  transmitted  through  the  2-D  trans¬ 
parency,  h,(x,  y),  is  imaged  onto  the  output  plane  by  lenses 
L  5  and  Ly.  The  charge  that  is  photogenerated  on  the  detec¬ 
tor  due  to  a  light  pulse  that  occurs  when  the  nth  line  of  the 
input  image  is  entered  in  the  optical  processor,  is  propor¬ 
tional  to 

g(y.x'.n)-  | ff(x,n)h,(x,y)dx^jh2(n,x ').  (14) 

The  total  charge  that  is  generated  and  accumulated  on  the 
detector  for  all  lines  is 

g(Y.*')~  T,ff(x,n)hi(x,y)hy(n,x')dx.  (15) 

The  operation  performed  by  this  processor,  as  described  by 
(15),  is  a  2-D  linear  operation  on  the  image  f(x,n)  whose 
kernel  is  equal  to  the  product  of  the  functions  h,(x,  y)  and 
h2(n,x').  The  image  is  processed  by  continuous  spatial 
integration  along  one  of  its  dimensions  and  by  the  summa¬ 
tion  of  the  individual  lines  through  temporal  integration  on 
the  detector,  in  the  other  dimension  Even  though  any 
separable-kernel  linear  operation  can  be  implemented  with 
the  system  of  Fig.  9,  an  improved  TSI  architecture  can  often 
be  designed  for  a  particular  separable  kernel  For  example, 
the  TSI  2-D  Fourier  transforming  system  that  was  discussed 
earlier  in  this  section,  is  simpler  and  therefore  preferable  to 
the  system  of  Fig.  9,  which  can  perform  the  same  operation 
if  hi  and  h2  are  chosen  appropriately.  TSI  architectures  for 
synthetic-aperture  radar  image  formation  [50],  [51]  and  for 
the  calculation  of  the  moments  of  an  image  [52]  have  been 
designed  by  Psaltis  and  Wagner 

2-D  shift-invariant  operations  are  a  very  important  class 
of  operations  that  can  also  be  implemented  with  TSI  archi¬ 
tectures,  since  such  operations  are  useful  in  many  image 
processing  applications  Let  f(x,  n)  denote  an  input  image, 
where  x  is  a  continuous  variable  and  n  is  an  integer 
denoting  the  line  number  of  the  image,  and  let  h(x.n)  be 
the  reference  image.  The  2-D  correlation  between  f  and  h 
is 


g{x',m)  —  £  j  f(x,n)h(x  +  x',n  +  m)  dx  (16) 

n 

The  integer  m  in  the  above  equation  enumerates  the  lines 
of  the  2-D  correlation,  whereas  the  continuous  variable  x' 
is  used  in  the  other  direction.  The  2-D  correlation  is  formed 
by  continuous  integration  in  x  and  summation  over  n.  since 
the  images  are  represented  by  discrete  lines  in  our  notation 
The  summation  over  n  is  realized  by  temporal  integration 
on  the  detector  in  the  implementation  of  (16)  with  a  TSI 
architecture  The  1-D  integral  in  the  x  direction  is  the 
correlation  of  each  line  of  the  input  image  with  all  lines  of 
the  reference  image,  i  e  .  for  each  value  of  n  the  correlation 
is  performed  for  all  possible  values  of  m  This  operation  is 
performed  in  a  TSI  processor,  with  a  1-D  multichannel 
space  integrating  correlator  in  which  the  different  lines  of 
the  reference  image  are  stacked  in  the  dimension  orthogo¬ 
nal  to  x.  Therefore,  the  index  m  in  (16)  corresponds  to  the 
vertical  spatial  location  at  which  a  line  of  the  correlation 
forms  in  the  optical  system  Notice  that  in  (16)  the  1-D 
correlations  of  the  nth  input  line  must  be  shifted  m  the  m 
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direction  by  n  pixels  before  the  summation  over  n  is 
performed.  This  shift  can  be  implemented  in  the  optical 
system  with  a  vertical  deflector  that  positions  the  1-D 
correlations  appropriately  on  the  detector  or,  alternatively, 
by  electronic  scanning  with  a  CCD  detector  array.  The  CCD 
implementation  will  be  discussed  in  more  detail  in  the 
following  paragraph.  One  possible  implementation  of  a 
space  integrating  multichannel  correlator  is  through  multi¬ 
plication  in  the  spatial  frequency  domain  of  the  transform 
of  each  input  line  with  the  transforms  of  all  the  lines  of  the 
reference,  which  can  be  stored  in  the  optical  system  as  a 
1-D  Fourier  transform  hologram  [53],  This  implementation 
combined  with  a  scanning  CCD  has  been  recently  demon¬ 
strated  experimentally  at  Caltech  [54], 

Images  can  also  be  processed  with  a  2-D  time  integrating 
processor,  using  1-D  input  devices.  This  becomes  apparent 
by  considering  the  triple-product  processor  (an  architecture 
in  which  temporal  integration  is  performed  in  both  dimen¬ 
sions)  which,  according  to  our  discussion  in  the  previous 
section,  can  be  configured  to  calculate  the  folded  spectrum 
of  a  1-D  signal  Therefore,  the  analogy  between  the  folded 
spectrum  of  a  1-D  signal  and  the  2-D  Fourier  transform  can 
be  applied  in  this  case  as  well,  to  conclude  that  the  triple¬ 
product  processor  can  also  be  used  for  the  calculation  of 
the  2-D  spectrum  of  an  image  [61].  Time  integrating 
processors  can  also  be  configured  to  perform  a  wider  class 
of  image  processing  operations.  We  will  discuss  here  a  time 
integrating  image  correlator,  shown  in  Fig.  10,  that  was 
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Fig.  10.  Time  integrating  image  correlator 

recently  described  by  Psaltis  [55J.  They  system  consists  of  a 
multichannel  time  integrating  correlator  in  conjunction  with 
a  scanning  2-D  CCD  detector  A  TV  camera  is  used  to  raster 
scan  the  input  image  and  the  video  signal  is  applied  to  the 
AOD  The  reference  image  is  stored  in  an  electronic  mem¬ 
ory  (digital  or  CCD).  The  memory  is  interfaced  to  an  array 
of  LEDs  in  a  way  that  allows  each  line  of  the  reference 
image  to  modulate  the  intensity  of  a  separate  LEO  The 
LEDs  are  modulated  cyclically  during  the  time  one  of  the 
lines  of  the  input  image  is  traveling  through  the  AOD, 
the  intensity  of  the  LEDs  is  temporally  modulated  by  the 
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lines  of  the  reference  image  and  the  LED  modulation  is 
repeated  every  time  a  new  input  line  enters  the  AOD.  The 
LEDs  illuminate  the  AOD  uniformly  in  the  horizontal  (x) 
direction  and  the  light  diffracted  by  the  AOD  is  imaged 
horizontally  at  the  output  plane  of  the  processor.  In  the 
vertical  direction,  the  light  distribution  at  the  output  plane 
is  an  image  of  the  LED  array.  The  charge  that  accumulates 
on  the  2-D  CCD  detector  array  that  is  placed  at  the  output 
plane  in  Fig.  10  during  the  time  that  the  nth  input  line 
travels  through  the  AOD  is  proportional  to 

g'ix.m.n)  -  j  1(t  -  x/v,n)h(t,m)  dt.  (17) 

The  functions  i  and  h  represent  the  input  and  reference 
images,  respectively,  and  the  integer  m  enumerates  the 
lines  of  the  reference  image.  Since  each  line  of  the  refer¬ 
ence  modulates  a  separate  LED  and  each  LED  is  located  at  a 
different  vertical  position,  the  integer  m  in  (17)  also  indi¬ 
cates  the  vertical  position  on  the  CCD  detector  The  origin 
of  the  axis  of  the  time  variable,  t,  in  (17)  is  reset  to  zero  at 
the  beginning  of  each  horizontal  scan  of  the  TV  camera  for 
notational  convenience.  At  the  completion  of  each  horizon¬ 
tal  scan,  the  2-D  charge  pattern  stored  on  the  CCD  is 
transferred  vertically  by  one  pixel.  At  the  initiation  of  each 
horizontal  scan,  the  electronic  memory  also  begins  to  read 
out  the  reference  image  stored  in  it.  When  all  N  lines  of  the 
input  image  have  been  processed,  the  signal  that  was 
photogenerated  by  the  nth  input  line,  has  been  transferred 
vertically  on  the  detector  by  (N  -  n )  pixels.  The  total  signal 
that  is  accumulated  on  an  element  of  the  CCD  detector 
array,  located  at  horizontal  position  x  at  the  mth  row  of  the 
array,  is  given  by 

g(x.m)  -  £*'(  xf  m  +  n  -  N,n) 

n 

-?/'<  t  +  x/v,n)h(t,m  +  n  -  M)  dt  ( 18) 

n 

g(x,m)  is  the  correlation  between  the  input  image  1  and 
the  reference  image  h  shifted  in  the  vertical  direction  by  N 
pixels.  The  correlation  is  read  out  by  the  CCD  in  the  form 
of  an  electronic  video  signal  that  can  be  displayed  on  a  TV 
monitor  or  processed  further  electronically.  In  this  architec¬ 
ture,  1-D  devices  are  used  to  enter  both  the  input  and 
reference  images  in  the  optical  processor  Since  the  refer¬ 
ence  image  is  stored  electronically,  rather  than  optically  on 
a  2-D  SLM,  it  can  be  generated  with  a  digital  computer  and 
stored  in  the  memory  directly  This  feature  can  be  very 
useful  in  pattern  recognition  applications,  where  typically 
an  optimum  reference  is  generated  digitally  [56]  and  the 
need  to  fabricate  a  computer-generated  hologram  is  thereby 
avoided.  Furthermore,  this  image  processing  architecture 
has  unique  flexibility,  since  the  reference  image  can  be 
periodically  reprogrammed  by  the  digital  computer. 

V  Conclusion 

The  design  of  optical  processing  architectures, has.  in  a 
sense,  gone  through  a  complete  cycle  After  the  early  success 
of  2-D  architectures,  such  as  the  synthetic-aperture  radar 
processors,  1-D  architectures  emerged  that  became  practi¬ 
cal  as  1-D  input  devices  (primarily  AODs)  were  developed 
More  recently  the  same  1-D  devices  have  been  used  in  a 
new  generation  of  2-D  architectures  The  pnmarv  motiva¬ 
tion  for  the  development  of  these  architectures  has  proba- 
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bly  been  the  availability  of  the  well-developed  1-0  devices. 
In  the  process  the  field  has  been  enriched  greatly.  A  wider 
class  of  linear  operations  is  possible  with  2-D  architectures 
that  are  implemented  with  1-D  devices  and  more  flexibility 
exists  in  the  way  a  particular  linear  operation  can  be  per¬ 
formed  Dynamic  processing  (time  integration  and  systolic 
processing)  that  is  feasible  with  1-0  devices,  coupled  with 
the  high  computational  power  that  is  possible  in  a  2-0 
optical  system,  has  resulted  in  the  most  powerful  and 
flexible  optical  processors  to  date.  Finally,  the  abundant 
processing  power  that  is  available  in  these  architectures  can 
be  traded  for  increased  accuracy,  most  notably  through  the 
use  of  the  method  of  binary  multiplication  by  analog  con¬ 
volution  [57],  [16],  This  can  lead  to  optical  processors  that 
have  accuracy  compatible  with  digital  systems  and  thus 
increase  the  applicability  of  optical  computing  to  more 
general  problems  involving  linear  numerical  calculations. 

Future  architectural  designs  will  certainly  be  influenced 
by  the  state  of  the  art  of  optical  devices.  As  real-time  2-0 
spatial  light  modulators  become  practical,  they  will  be 
incorporated  in  2-D  architectures  that  use  1-0  devices  as 
broad-band  input  transducers  and  2-0  devices  for  massive, 
programmable  storage  in  the  optical  system.  The  develop¬ 
ment  of  2-D  input  devices  that  are  compatible  with  dy¬ 
namic  processing,  such  as  multiple-transducer  AODs  [58], 
will  make  new  architectural  designs  feasible.  Nonlinear 
optical  devices  can  also  a  have  a  major  impact;  if  one-  or 
two-dimensional  arrays  of  optical  bistable  devices  become 
feasible,  then  it  will  be  possible  to  implement  optical 
computers  that  perform  not  only  linear,  but  more  general 
computations  Such  an  optical  computer  would  be  more 
powerful  than  a  digital  computer,  not  because  optical  gates 
may  be  faster  than  electronic  gates,  but  because  the  optical 
computer  can  be  easily  configured  in  the  three-dimensional 
space  and  thus  have  massive  parallelism  and  interconnec¬ 
tion  capability 
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An  optical  processing  method  is  presented  which  allows  the  correlation  of  two  images  to  be  computed  in  real 
time  with  a  1-D  acoustooptic  spatial  light  modulator  as  the  input  device.  Two-dimensional  processing  is 
accomplished  by  a  combination  of  spatial  and  temporal  integration.  The  time-integrating  processing  is  per¬ 
formed  by  a  CCD  detector  that  is  operated  as  an  optically  addressed  correlator. 


I.  Introduction 


Optical  image  processors  normally  require  at  the 
input  stage  a  real-time  2-D  spatial  light  modulator 
(SLM)1  which  creates  a  suitable  transparency  corre¬ 
sponding  to  the  input  image.  The  relatively  immature 
state  of  development  of  2-D  SLMs  is  a  major  factor  that 
has  prevented  the  realization  of  the  huge  potential  of 
optical  image  processors.  The  limitations  presently 
imposed  by  the  SLMs  can  be  overcome  either  by  further 
developments  in  device  technology  or  alternatively  by 
modifying  the  optical  system  architecture.  Several 
architectural  designs  have  been  proposed  for  this  pur¬ 
pose.2-4  For  example,  if  the  optical  processor  can  be 
implemented  with  noncoherent  illumination  the  re¬ 
quirements  on  the  optical  quality  of  the  SLM  can  be 
relaxed,  and  a  self-luminous  display  (such  as  a  CRT) 
could  be  used  as  the  input  SLM.  In  a  recent  publica¬ 
tion  by  the  author3  a  2-D  signal  processing  technique 
has  been  presented  that  does  not  require  the  use  of 
real-time  2-D  SLMs.  This  is  accomplished  by  entering 
the  2-D  input  data  into  the  optical  processor  one  line  at 
a  time  using  a  1-D  acoustooptic  SLM.5  Each  line  is 
filtered  spatially  by  the  optical  system.  The  data  are 
processed  in  the  second  dimension  by  integrating  the 
response  due  to  consecutive  lines  on  a  time-integrating 
detector  array.  Acoustooptic  technology  is  highly  de¬ 
veloped  and  consequently  high  quality  acoustooptic 
SLMs  can  be  fabricated.  The  use  of  acoustooptic  de¬ 
vices  (AOD)  rather  than  2-D  SLMs  in  the  optical  pro¬ 


cessor  can  lead  to  improvements  in  accuracy,  speed,  and 
practicality  (size,  weight,  power  requirements,  cost).  In 


The  author  is  with  California  Institute  of  Technology.  Department 
of  Electrical  Engineering,  Pasadena.  California  91 125. 

Received  7  August  1981. 

000.1-69.15/82/030491  -05S01.00/0. 
t  1982  Optical  Society  of  America. 


v.v- 


this  paper  we  describe  the  application  of  the  time- 
and -space  integrating  processing  technique  to  the  im¬ 
plementation  of  an  image  correlator.  Image  correlation 
is  a  useful  signal  processing  operation  in  pattern  rec¬ 
ognition,  image  restoration  and  enhancement,  and  video 
compression  and  is  also  the  most  powerful  operation 
that  can  be  implemented  by  an  optical  computer. 
Therefore,  image  correlation  is  probably  the  most  sig¬ 
nificant  2-D  signal  processing  operation  that  can  be 
implemented  with  the  time-and-space  integrating 
method.  In  the  following  section  we  describe  the  op¬ 
eration  of  the  optical  image  correlator,  and  in  Sec.  Ill 
we  discuss  the  unique  characteristics  of  this  architec¬ 
ture. 

II.  Description  of  the  Processor 

The  time-and-space  image  correlating  architecture 
is  shown  in  Fig.  1.  We  will  demonstrate  that  this  sys¬ 
tem  computes  the  cross-correlation  g(xj )  of  two  com¬ 
plex  functions /(x^y)  and  h(x,y): 

“  if  /(x.yl/i'fx  +  io1  +  $)dxdy.  (1) 

The  operation  of  the  correlator  in  Fig.  1  can  be  sum¬ 
marized  as  follows:  the  optical  system  is  a  multichannel 
1-D  correlator  which  consecutively  correlates  each  row 
of  the  function  f(x,y)  with  all  rows  of  the  function 
h(xy).  The  AOD  is  used  to  enter  the  rows  of  /(x,y) 
sequentially  into  the  optical  system.  The  1-D  corre¬ 
lations  are  summed  appropriately  by  operating  the  CCD 
detector  in  the  shift-and-add  mode.6  The  key  com¬ 
ponents  of  the  system  are  the  AOD  and  the  CCD  de¬ 
tectors. 

The  AOD  consists  of  a  piezoelectric!  transducer 
bonded  onto  an  acoustooptic  crystal.  We  denote  the 
voltage  applied  to  the  piezoelectric  transducer  by  s(f ). 
The  signal  s(f)  has  theforms(f)  =  n(f)cos[u>of  +  <Mf)J, 
where  the  complex  envelope  a  (f )  «  or(f )  exp[/<f>(f )]  is  the 
modulating  signal  and  Wo/2it  is  the  center  frequency  of 
the  AOD.  The  device  is  illuminated  by  a  collimated 
light  beam  incident  at  the  Bragg  angle  0/j,  where7 
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Fig.  1.  Image  correlator  architecture. 


sin^s 


Xi^o 

4iri> 


(2) 


A  is  the  wavelength  of  light  in  the  acoustooptic  crystal, 
and  u  is  the  speed  of  sound  in  the  crystal.  The  acoustic 
wave  that  is  induced  by  the  voltage  s(t )  causes  a  portion 
of  the  incident  light  to  be  diffracted.  In  the  Bragg  re¬ 
gime  essentially  all  the  diffracted  energy  is  concentrated 
in  the  first  order.  For  relatively  weak  modulation  levels 
the  amplitude  of  the  diffracted  light  E(x',t)  is  given 
by8 


E(x',t)  a  ci  reel 
X  exp 
■  Ci rect 


’  /  .2x-9in0flx'I 

X  expljwot )  exp  I-J - - - 1  •  (3) 

In  Eq.  (3)  Ci  is  a  constant,  x'  is  along  the  direction  of  the 
acoustic  wave  propagation,  and  A  is  the  aperture  of  the 
AOD.  Thus,  the  amplitude  of  the  diffracted  light  is 
modulated  by  the  complex  signal  a{t  —  x'/v)  over  the 
spatial  window  A,  Doppler  shifted  by  the  traveling 
acoustic  wave  by  u>o/2ir,  and  deflected  around  the  Bragg 
angle  Or.  For  the  rest  of  our  discussion  we  will  not  carry 
the  deflection  term  exp|-;(2?r  sin0flx')/A)  in  the 
equations  since  it  does  not  affect  the  operation  of  the 
system  we  will  describe.  In  Eq.  (3)  the  origin  of  the  x' 
coordinate  is  assumed  to  be  at  the  piezoelectric  trans¬ 
ducer,  and  x'  increases  away  from  the  transducer.  In 


our  analysis  it  is  more  convenient  to  use  the  coordinate 
transformation  x  =  — +  A.  In  the  x -coordinate  sys¬ 
tem  the  origin  is  at  the  far  end  of  the  acoustooptic 
crystal,  and  x  increases  toward  the  transducer. 
Equation  (3)  can  be  rewritten  as  follows: 

E(x,i)  -  ci  rect  a  |r  +  -  -  — J  expC/woO  (4) 

We  shall  use  Eq.  (4)  in  the  rest  of  our  discussion. 

The  CCD  image  sensor  consists  of  a  matrix  of  pho¬ 
tosensitive  sites  where  incident  photons  are  converted 
to  electronic  carriers  which  are  trapped  locally  in  the 
depletion  region  of  a  MOS  junction.9  The  photogen¬ 
erated  charge  packets  can  be  transferred  to  adjacent 
pixels  along  one  of  the  dimensions  of  the  array  by 
applying  a  clock  waveform  to  the  device.  When  the 
device  is  used  as  an  image  sensor,  each  charge  packet  is 
shifted  continuously  along  the  array  after  a  single  ex¬ 
posure  to  light  until  it  reaches  the  edge  of  the  device 
where  an  output  CCD  stage  transfers  the  signal  to  the 
output  pin.  In  our  system  the  CCD  array  is  exposed 
periodically.  After  each  exposure  the  charge  that  is  ac¬ 
cumulated  in  each  site  is  shifted  by  only  1  pixel.  The 
photogenerated  charge  due  to  the  most  recent  exposure 
is  simply  added  to  the  charge  that  is  already  stored  in 
each  pixel.  In  Fig.  1  the  spatial  dimension  along  the 
shifting  direction  of  the  CCD  is  denoted  by  y.  Let  the 
intensity  of  the  illuminating  light  at  the  location  y 
during  the  nth  exposure  be  denoted  by  /(n,y).  The 
charge  generated  at  the  pixel  located  aty  during  the  nth 
exposure  is  proportional  to  /(n,y ).  After  N  exposures 
(N  >  n),  the  charge  I(n,y)  shifts  N  -  n  pixels  or  by  a 
distance  (N  -  n )  Ay  in  the  y  direction.  Ay  is  the  pixel 
separation.  The  charge  that  is  accumulated  in  the  CCD 
as  a  function  of  pixel  position  y  after  N  exposures  is 
given  by 

<?<>•)  =  £  +  <n  -  JV)A>j.  (5) 

n  *  1 

for  y  =  0  toy  =  M  Ay,  where  M  is  the  number  of  pixels 
in  the  CCD  and  I(nj)  =  0  for  all  y  <  0.  The  maximum 
number  of  exposures  N  for  which  the  addition  in  Eq.  (3) 
can  be  performed  is  equal  to  M.  Bromley,  and  Mona¬ 
han  eta/.6  have  used  a  CCD  detector  array  in  this  mode 
of  operation  to  perform  a  variety  of  1-D  linear  opera¬ 
tions.  In  our  system  we  use  the  CCD  detector  to  con¬ 
struct  an  array  of  parallel  1-D  correlators. 

In  most  image  recognition  applications  the  input 
scene  and  the  filter  functions  are  real.  For  this  reason 
and  to  present  the  principles  of  operation  of  the  system 
more  clear! y,  we  will  restrict  our  analysis  initially  to  real 
functions  f  and  h.  For  completeness  we  will  describe 
the  operation  of  the  system  with  complex  signals  f  and 
h  at  the  end  of  this  section.  The  1-D  Fourier  transform 
of  a  transparency  with  amplitude  transmittance  h(xu\) 
is  formed  with  an  astigmatic  lens  svstem'which  trans¬ 
forms  in  thex  direction  and  images  along  y. 10  A  holo¬ 
gram  of  the  resulting  light  amplitude  distribution  is 
formed  by  recording  its  interference  with  a  plane  wave 
reference  on  photographic  film  or  any  other  suitable 
device.  The  amplitude  transmittance  of  the  developed 
hologram  is  proportional  to"’ 
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|B  exp(-j2x  tin $nFfM)  +  H(/,.y)|2 

-BJ+  |«(/-0'H2 

+  e«p(-;2r  sin 6hF(x) 

+  BH(fty)  txp(+ j2r  tinSHFfr),  (6) 

where 

H(/».y)“  pi(x.y)  expt,-j2xftx  i, , 

6h  is  the  angle  of  incidence  on  the  hologram  of  the  ref¬ 
erence  beam,  B  is  its  amplitude,  F  is  the  focal  length  of 
the  lens  in  the  x  direction,  and  fx  is  the  spatial  frequency 
variable  which  is  linearly  related  to  the  spatial  variable 
£  in  the  plane  of  the  hologram  ifx  *  £/(\F)).  In  Eq.  (6) 
only  the  term  containing  H*  contributes  to  the  corre¬ 
lation,  and  the  remaining  terms  are  blocked  out  in  the 
optical  system.  Thus  the  effective  complex  transmit¬ 
tance  of  the  hologram  can  be  written 

f«(/, O')  ■  BH*(J,j)  exp(-j2r  sin 6HFfx).  (7) 

This  hologram  is  placed  in  plane  P2  of  Fig.  1. 

The  image  /(x,y)  is  scanned  in  a  raster  format  to 
produce  a  temporal  electronic  signal  r  (£ ).  The  raster 
signal  r(t)  is  related  to  the  2-D  function  fix.y)  by  the 
following  equation: 

r(t)  m  f\[t  -  (n  -  l)T|u„nAy|  (8) 


t$(t)  -  net  |-  ~^j 

for  n  =  1  to  N,  where  r  is  the  duration  of  each  light 
pulse,  and  the  pulse  shape  has  been  approximated  by 
a  rectangular  function.  The  light  diffracted  by  the 
AOD  is  modulated  by  the  product  of  Eq.  (9)  and  (11). 
We  denote  this  modulation  function  by  tsA  (x  ,t ).  For 
1/r  larger  than  the  bandwidth  of  r(t),  tsA  can  be  ap¬ 
proximated  by 


tSA(x,t)  -  tsU)tx(x.t) 


-  expO'wot )  rect  (- — f  ||f  +  ^  -  htJ 
a  /(x.nAy )  expijwot )  rect 


c.nAy 


(12) 


Lens  L\  in  Fig.  1  is  used  to  collimate  this  light  distri¬ 
bution  in  the  vertical  direction  so  it  illuminates  the 
hologram  in  plane  P2  uniformly  in  the  y  direction.  Lens 
L2  takes  the  Fourier  transform  in  the  x  direction.  The 
amplitude  of  the  light  entering  plane  P2  is  modulated 
by 


tsxUz.t.n)  -  /tsA<x.O  exp(-j'2»/,x)  dx 


”  F(/,,nAy)  expijwot)  rect 


(13) 


for  n  =  1  to  N,  where  u,  is  the  scanning  velocity  of  the 
device  (such  as  a  TV  camera)  that  produces  the  raster 
signal,  T  is  the  duration  of  each  raster  line  [usT  is  the 
size  of  /(x, y)  in  the  x  direction],  and  Ay  is  the  resolution 
of  /(x,y)  in  the  y  direction  [NAy  is  the  size  of/(x,y)  in 
the  y  direction].  In  Eq.  (8)  we  assume  that  fix, y)  ■  0 
for  x  >  v,T  and  x  <  0.  r(£ )  is  heterodyned  to  the  center 
frequency  w0  and  applied  to  the  AOD  in  plane  Pi  of  Fig. 
1.  The  modulation  tA  (x  ,£ )  introduced  by  the  AOD  on 
the  amplitude  of  the  diffracted  light  can  be  found  by 
substituting  ait)  by  r(£)  in  Eq.  (4): 


where 

f(/„niy)  “  J7(x,nAy)  eip(-;2*/,x)  dx 

The  light  immediately  after  plane  P2  is  modulated  by 
the  product  of  Eqs.  (7)  and  (13).  The  astigmatic  lens 
system  L3  images  plane  P2  onto  the  output  plane  P3  in 
the  y  direction,  while  it  performs  the  Fourier  transform 
in  the  horizontal  (x )  direction.  The  amplitude  of  the 
light  at  plane  P3  is  given  by 

-  fts»(f,,t.n)tH(fxS)expi-j2Tfxt'df.) 


t„(x,l)  -  Ci  rect  r  +  "  -  ~)  «xpOW ) 

“  ci  rect  | — — — J/  [((  + - nT  +  7"j  u,,nAy 

x  expijwot)  (9) 

We  set  A  =  u,T,  i.e.,  the  aperture  of  the  AOD  can  ac¬ 
commodate  exactly  one  raster  line  of  /(x,y).  For  con¬ 
venience  we  also  set  v,  =  u.  At  time  instances  t  -  nT 
the  modulation  of  the  AOD  is  given  by 


tA<x,nT) 


lx  -  A/ 2) 

I  _  x  A  \ 

(  vT  V 

f  (nT  + - nT  +  T  D.nAv 

\  V  v  /  ' 

X  *xp(ju>onT) 


«  ci/(x,nAy)  eipOiconD. 


(10) 


The  rect  function  can  be  dropped  in  Eq.  (10)  since  fix  y) 
was  defined  to  be  nonzero  for  0  <  x  <  uT.  Thus  at 
times  £  *  nT,  a  single  line  of  the  function  fix,y)  mod¬ 
ulates  spatially  the  light  diffracted  by  the  AOD.  A 
pulsed  light  source  is  used  in  the  system  to  illuminate 
the  AOD  only  at  the  instances  t  =  nT.  The  temporal 
modulation  of  the  source  can  be  written  as 


“  c2  expOico*)  reetd  -  nT)  / F(f, ,n Ay )//*(/, ,y ) 


X  exp|-;2x(*in8/ff  +  t')f,dfx ] 
m  c7  txpijwot )  rect 

X  jY(x,nAy)h(x  +  t,y)dx,  (14) 

where  x  =  x'  +  sin ShF  and  y  are  the  horizontal  and 
vertical  spatial  coordinates,  respectively,  in  P3,  and  c2 
is  a  constant.  The  convolution  theorem  was  used  to 
obtain  the  last  form  of  Eq.  (14).  The  output  light  dis¬ 
tribution  is  detected  interferometrically  by  the  CCD 
detector  array  at  the  output  plane  to  obtain  a  detected 
signal  proportional  to  Eq.  (14).  A  reference  beam  de¬ 
rived  from  the  same  source  is  heterodyned  to  the  center 
frequency  w0  of  the  AOD  and  made  incident  on  the 
detector  at  an  angle  0D.  The  amplitude  of  the  reference 
beam  is  described  by 


<*(x,M 


A 


exp(>2ir  sinOpx/X)  exp(/u’o/ )  rect 


(15) 


The  signal  /(x,y,n)  that  is  detected  by  the  CCD  is  pro¬ 
portional  to  the  time  integrated  intensity  of  the  sum  of 
Eqs.  (14)  and  (15) 
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;  *  .Ti 


■-  v  %' 


/(i,.v,n)  «  c:iSUd  +  tn\2dt 


J*n7'+r/2 

M  exp{j2vfox ) 

nT—r/2 


+  Sf(x,nA\)h(x  +  i,y)dx\2dt 
«  tc3|,42  +  |  J7(x,nAv)/i(x  +  x,y)dx|2 
+  2A|J7(x,nAy)/i(x  +  jc^ylrfjc)  cos(2t/ox)|,  (16) 

where  fo  =  sinOo/X.  The  third  term  in  this  equation  is 
the  1  -D  correlation  of  the  nth  row  of  fix  ,y )  with  all  the 
rows  of  h(x,y).  The  correlation  forms  on  the  spatial 
carrier  f0.  Since  both  /  and  h  are  real  functions  only  the 
amplitude  of  the  fringe  pattern  is  modulated.  In  the 
y  direction  the  CCD  is  operated  in  the  shift-and-add 
mode  described  earlier.  The  charge  that  is  accumulated 
in  the  CCD  after  N  light  pulses  can  be  found  by  sub¬ 
stituting  Eq.  (16)  into  Eq.  (5): 


qas)  -  I  Hi,n,y  +  <n  -  N)Ay| 

n  -  1 


«c«|AM2  +  £  \Sf(x,nAy)h[x  +  +  (n  -  A/)Ay)dx|2 

\  n-l 

+  '^[l  J7(x,nA;y )h(x  +  x\y  +  nAy  -  NAyldxj  cos(2ir/ox)j.  (17) 

The  third  term  in  Eq.  (17)  forms  on  a  spatial  carrier  of 
frequency  /o-  By  setting  /0  equal  to  or  larger  than  the 
bandwidth  of  f(xyi),  this  term  can  be  separated  from  the 
other  two  baseband  terms  by  electronic  filtering  after 
the  signal  from  the  CCD  is  converted  to  a  video  signal. 
The  envelope  of  the  carrier  in  Eq.  (17)  is  recognized  to 
be  the  2-D  correlation  described  by  Eq.  (1)  with  the 
integration  over  the  continuous  variable  y  replaced  by 
the  summation  over  the  discrete  variable  nAy.  The 
correlation  pattern  is  shifted  by  the  constant  NAy  in 
the  y  direction.  For  a  CCD  detector  with  N  horizontal 
rows,  this  means  that  each  slice  of  the  correlation  pat¬ 
tern  is  formed  sequentially  at  the  last  row  of  the  device. 
The  fast  horizontal  CCD  shift  register  transfers  each 
line  of  the  2-D  correlation  to  the  output  stage  of  the 
device  where  it  can  be  displayed  or  processed  further 
electronically. 

We  shall  close  this  section  by  discussing  how  the 
system  of  Fig.  1  can  be  used  to  correlate  complex  2-D 
functions^  We  assume  that  we  have  the  complex 
function  h(x,y)  recorded  either  holographically  or  in  a 
digital  memory.  The  1-D  Fourier  transform  of  this 
complex  function  can  then  be  produced  and  placed  in 
plane  P2  of  Fig.  1  either  optically  or  by  computer  gen¬ 
eration.  The  function  fix  ,y )  is  represented  by  two  real 
functions  that  correspond  to  its  real  and  imaginary 
parts.  The  two  corresponding  electronic  raster  signals 
are  used  to  modulate  in  quadrature  the  carrier  that  is 
applied  to  the  AOD.  From  Eq.  (4)  we  conclude  that  the 
modulation  introduced  by  the  AOD  is  proportional  to 
the  complex  signal  that  is  used  to  modulate  in  quadra¬ 
ture  the  carrier.  The  optical  system  performs  the 
complex  correlation  in  the  x  direction.  The  phase  of 
the  1-D  complex  correlation  is  preserved  in  the  phase 
of  the  fringe  pattern  in  Eq.  (16).  Thus  the  full  2-D 
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complex  correlation  is  formed  by  performing  the  addi¬ 
tion  over  n  in  Eq.  (17). 

III.  Discussion 

We  devote  this  section  to  the  discussion  of  the  char¬ 
acteristics  of  the  AOD/CCD  image  correlator.  The 
majority  of  the  potential  advantages  of  this  system  are 
consequences  of  the  use  of  an  AOD  as  the  real-time 
SLM.  AODs  have  been  investigated  and  manufactured 
for  many  years.  Consequently  reliable  and  relatively 
inexpensive  high  quality  devices  are  now  commercially 
available.  The  simple  structure  of  an  AOD  relative  to 
most  2-D  SLMs  allows  compact  systems  to  be  built  with 
relatively  low  power  requirements  and  without  the  need 
for  high  voltages.  Thus  the  use  of  AODs  can  lead  to 
practically  feasible  optical  image  processors  in  the  im¬ 
mediate  future.  The  excellent  modulation  character¬ 
istics  of  AODs11  (high  linear  dynamic  range,  spatial 
uniformity,  and  low  scatter  level)  allow  the  input  image 
to  be  represented  in  the  optical  computer  with  high  fi¬ 
delity,  with  a  corresponding  improvement  in  overall 
accuracy.  AODs  can  accept  data  at  rates  up  to  several 
gigahertz.  We  do  not  anticipate  however,  that  this 
capability  can  be  approached  by  the  AOD/CCD  image 
processor  in  the  near  future  because  of  limitations  in  the 
speed  with  which  the  CCD  can  be  read  out.  The  system 
also  requires  a  device  which  produces  an  electronic 
raster  signal  corresponding  to  the  input  image.  In  most 
applications  this  device  can  be  a  TV  camera.  The 
current  limitations  of  CCD  and  image  sensor  tech¬ 
nologies  impose  a  limit  of  a;50-MHz  input  rate  which 
corresponds  to  the  processing  of  200  images,  each  con¬ 
sisting  of  5002  pixels  in  1  sec.  The  need  for  an  auxiliary 
image  sensor  may  be  construed  as  a  disadvantage  of  this 
technique.  Ideally  it  is  preferable  to  have  a  device 
which  serves  simultaneously  as  the  image  sensor  and  the 
SLM  for  the  optical  computer.  In  many  applications, 
however,  2-D  SLMs  are  not  suitable  for  direct  detection 
of  the  live  scene,  and  an  auxiliary  sensor  must  be  used. 
The  output  of  the  auxiliary  sensor  is  then  scanned  onto 
the  2-D  SLM  either  electronically  or  optically.  In  such 
cases,  the  ability  of  the  AOD/CCD  system  to  accept 
directly  the  electronic  raster  signals  is  an  advantage. 

The  limitations  on  the  performance  of  the  AOD/CCD 
processor  are  imposed  primarily  by  the  CCD  detector. 
These  limitations  are  not  significantly  different  from 
the  limitations  imposed  by  the  detector  on  any  optical 
image  processor.  For  continuous  processing  of  frames 
the  input  data  rate  cannot  exceed  the  readout  rate  in  the 
AOD/CCD  processor.  The  speed  at  which  commer¬ 
cially  available  CCD  detector  arrays  are  normally  read 
out  is  5-10  MHz  (standard  video  frame  rates). 
Therefore,  the  processing  speed  is  limited  by  the  de¬ 
tector  if  one  is  restricted  to  using  commercially  available 
devices.  CCD  detectors  which  are  fabricated  specifi¬ 
cally  for  optical  signal  processing  applications  can  be 
made  with  several  parallel  output  stages,1-  which  in¬ 
creases  the  readout  speed.  For  example,  a  device  with 
10  parallel  readout  stages  could  be  read  out  at  50- 
100-MHz  rates.  In  addition,  current  research  in  GaAs" 
CCDs  shows  promise  of  extending  the  inherent  speed 


V 

.. 

ss# 

V>y-V- 

*  4^.  *  .  * 

*  •  V 


W-V 

VV  •>  , 

Vv\> 

i.-'s.-  *."  I, 


►  V*  _* 


-V'V-'.'J 
V.s'.n'.-J 
.■-w  ■< 


w  '  *  w  _ 

V  V  v  ‘J 


•VM-:-: 
V  V  v\» 


M  V  *  -P  *  - 
rv  VN‘ 

M  m  A  ^  A  "  m 


\  ••  .  A  v? 
* 

/vv-ii 


-.'I 

*■ 

- Vi1 


of  these  devices  to  hundreds  of  megacycles  per  second. 
CCD  detectors  have  ~500  X  500  pixels,14  and  devices 
with  over  one  thousand  pixels  in  each  dimension  are 
presently  under  development.  The  number  of  pixels 
of  the  CCD  in  the  nonshifting  dimension  determines  in 
this  dimension  the  space-bandwidth  product  of  the 
images  that  can  be  processed.  The  number  of  pixels  in 
the  shifting  direction  determines  the  space-bandwidth 
product  of  the  filter  in  the  shifting  dimension  but  does 
not  limit  the  size  of  the  input  scene.  In  other  words, 
this  processor  is  a  sliding  window  correlator  in  one  di¬ 
mension.  This  feature  can  be  useful  in  applications 
where  the  input  image  is  sensed  by  a  linear  detector 
array,  and  the  imaging  in  the  second  dimension  is  ac¬ 
complished  by  the  relative  motion  between  the  detector 
and  the  object.  The  dynamic  range,  noise,  linearity, 
and  spatial  nonuniformity  of  the  CCD  detector  are 
factors  that  affect  the  accuracy  with  which  the  pro¬ 
cessed  image  can  be  detected.  Commercial  CCD 
cameras  have  dynamic  range  in  excess  of  1000:1  with 
excellent  linearity  in  this  range.14  This  range  can  be 
extended  by  designing  CCDs  with  large  detector  ele¬ 
ments  that  can  store  a  larger  photogenerated  charge  and 
also  by  cooling  the  device  and  using  postdetection 
electronic  processing  to  minimize  detector  noise.  The 
detector  noise  is  caused  by  shot  noise  of  the  signal  and 
leakage  current,  feed-through  of  clock  transients,  and 
thermal  noise  in  the  amplifiers.14  The  trade-off  be¬ 
tween  output  noise  and  bandwidth  is  the  major  engi¬ 
neering  challenge  in  the  design  of  the  AOD/CCD  image 
processor.  The  portion  of  the  detector  dynamic  range 
that  is  utilized  to  represent  the  output  signal  is  pro¬ 
portional  to  the  ratio  of  the  signal  to  the  bias  terms  in 
Eq.  (17): 

N 

2/1  £  //(x.nAvIMx  +  x.nAy  +  y)dx 

SBR  =  - — -  (18) 

NA*  +  V  |  J7<x,nAy)h|x  +  x S'  +  (n  -  N)Ay|dx|2 

n  •  1 

For  SBR  =  1,  half  of  the  dynamic  range  is  utilized.  The 
SBR  however  can  be  significantly  lower  depending  on 
the  functions  /  and  h .  It  is  thus  crucial  to  maximize  the 
dynamic  range  of  the  CCD. 

We  are  considering  two  types  of  pulsed  source  for  this 
system:  mode-locked  gas  lasers7  and  semiconductor 
lasers."  Gas  lasers  can  satisfy  all  the  requirements  of 
the  system  (pulse  width,  peak  power,  coherence,  sta¬ 


bility),  but  semiconductor  lasers  are  attractive  because 
they  are  compact,  efficient,  and  relatively  inexpensive. 
The  modes  in  a  semiconductor  laser,  however,  are  so 
widely  spaced  because  of  the  short  cavity  length  that 
interferometric  detection  is  feasible  only  with  a  sin¬ 
gle-mode  laser.  Single-mode  laser  diodes  can  be  fab¬ 
ricated  and  are  even  available  commercially.  However 
when  these  diodes  are  pulsed  several  modes  exhibit  gain 
during  the  transients.  For  a  well-fabricated  diode  the 
transients  decay  within  1  nsec.15  Thus,  if  a  pulse  with 
duration  of  5  nsec  is  used,  single-mode  operation  can  be 
obtained  80%  of  the  time. 

The  operation  of  the  CCD  detector  in  the  shift-and- 
add  mode  has  an  important  advantageous  consequence. 
Since  the  signal  that  eventually  reaches  the  output  stage 
of  the  detector  is  a  weighted  sum  of  the  signal  detected 
by  all  the  detector  elements  in  a  single  column  of  the 
CCD  array,  the  variations  in  the  responsivity  among  the 
individual  pixels  and  dark  current  will  average  out.14 
In  addition,  speckle  noise  which  is  uncorrelated  from 
pixel  to  pixel  will  also  average  out.  Thus  the  system 
utilizes  coherent  light  which  provides  the  flexibility  of 
easily  synthesizing  a  filter  in  the  spatial  frequency  do¬ 
main  but  is  immune  to  coherent  noise. 
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ABSTRACT 


Optical  Image  correlators  are  presented 
that  use  acousto-optic  and  charge-coupled 
devices  as  the  Input  and  output  transducers 
respectively.  Experimental  results  are  pre¬ 
sented  and  the  applicability  to  pattern  recog¬ 
nition  of  a  non-linear  pseudo-correlation  that 
can  also  be  conveniently  computed  Mlth  these 
processors.  Is  discussed. 


INTRODUCTION 

Image  processing  Is  perhaps  the  most 
natural  application  of  optical  Information 
processing  because  the  two  dimensions  of  the 
optical  system  and  Its  parallel  processing 
capability  are  very  effectively  utilized  In  this 
application.  The  potential  of  optical  Image 
processors  however,  can  only  be  realized  In 
practice  If  suitable  transducers  are  available 
to  bring  the  Images  Into  the  optical  processor 
with  sufficient  speed  and  accuracy  and  also 
transducers  (detectors)  to  read-out  the  processed 
Images.  In  recent  years  the  development  of 
Acousto-Optic  Devices  (AOD)  and  semiconductor 
detector  arrays  and  light  sources,  has  led  to  the 
development  of  high  performance  optical  processors 
[1,2],  In  this  paper  we  discuss  how  acousto¬ 
optic  devices  and  CCD  detectors  can  be  used  for 
optical  Image  correlation.  The  acousto-optic 
device  Is  used  as  the  Input  transducer  In  the 
optical  processor  and  It  receives  the  Image  to  be 
processed  In  the  form  of  a  video  electronic 
signal.  The  CCD  is  used  as  the  optical  detector 
In  the  system  and  simultaneously  as  an  array  of 
electro-optic  correlators.  The  advantages  that 
can  be  derived  from  the  use  of  these  relatively 
mature  technologies  In  the  Implementation  of  an 
optical  2-D  correlator  are  high  speed,  flexibil¬ 
ity.  accuracy,  small  physical  size  and  power 
efficiency. 

In  the  following  section  we  discuss  the 
general  method  for  performing  Image  correlation 
with  an  acousto-optic  processor.  In  section  III 


we  review  the  holographic  Implementation  of  such  a 
processor  and  the  experimental  results  of  this 
Implementations  are  included  In  section  IV. 


6ENERAL  CONCEPT 

The  correlation  g(E.n)  of  an  Input  Image 
f(x.y)  and  a  reference  Image  h(x,y)  Is  given  by: 

g(E.n)  -//f(x.y)  h(x+E,  y+n)dxdy.  0) 

We  are  concerned  here  with  the  Implementation 
of  this  operation  with  an  optical  system  In  which 
the  Input  Image  f(x,y)  Is  Introduced  through  an 
AOD.  AOD's  are  1-D  spatial  light  modulators  with 
a  linear  space  bandwidth  product  typically  equal 
to  103  pixels.  The  size  of  the  Images  that  we 
like  to  be  able  to  process  optically  Is  at  least 

103xl03  pixels.  Therefore,  It  Is  clear  that  an 
AOD  cannot  be  used  to  simultaneously  modulate  a 
light  beam  with  an  entire  Image.  Typically,  a 
Single  line  of  the  Image  can  be  accomnodated  by 
the  AOD  at  one  time.  This  fact  dictates  our 
processing  strategy:  the  Input  image  Is  entered 
Into  the  optical  processor  and  processed  one  line 
at  a  time.  The  processed  Image  lines  are  detected 
and  accumulated  on  a  2-D  CCD  camera  [2].  The 
Image  f(x,y)  must  be  sampled  In  one  of  its 
dimensions  (In  our  notation  the  y-dimension)  so 
that  its  lines  can  be  applied  sequentially  to 
the  AOD.  In  practice  this  Is  accomplished  by 
detecting  f(x,y)  with  a  raster  scanning  TV  camera. 
Since  the  correlation  g(C,n)  will  be  computed  from 
the  samples  of  f(x,y)  we  replace  the  Integration 
over  the  continuous  variable  y  In  Eq.  (1)  by  a 
summation: 

N  f 

g(E,n)  ■  I  |  f (x.nAy)  h  (x+E.nAy  ^ti)  dx  .  (2) 


By  Is  the  sampling  Interval  In  the  y  direction  and 
If  It  Is  chosen  to  be  at  the  Nyquist  rate 
(assuming  f  Is  bandlimited)  the  correlation  g 
computed  via  Eq.  (2)  does  not  differ  from  the 
continuous  correlation.  N  Is  the  number  of  lines 
In  f(x,y).  We  can  write  the  shift  In  the  n 

direction  by  nAy  In  the  above  equation  as  a 
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convolution  with  a  delta  function  6(n+nAy)  and 
derive  the  following  fort*  for  the  correlation 
g(E.n): 

N 

g(E.n)  -  E  1 1  |f(x,n4y)  h  (x+E.r 
n. 


rJJJfCx.nAy)  h  (x+E.n')dxj 


6(n'-n-ndy)dn' 


(3) 


This  form  of  the  correlation  function 
determines  directly  the  Implementation  algorithm 
of  the  acousto-optic  Image  correlator.  The  term 
In  the  brackets  In  Eq.  (3)  Is  the  1-D  correlation 
In  the  x  direction  of  the  nth  line  of  the  Input 
Image  with  all  the  lines  of  the  reference. 
Several  optical  Implementations  of  such  a  multi¬ 
channel  1-D  correlator  are  possible.  The  term  In 
the  brackets  In  Eq.  (3)  Is  a  function  of  two 
variables  E  and  n',  and  It  must  be  shifted  In  the 
n'  direction  by  the  distance  niy.  In  other  words 
the  1-D  correlations  of  the  first  line  of  the 
Input  are  shifted  by  1  pixel  In  the  n'  direction, 
while  the  correlations  of  the  Nth  line  are 
shifted  by  N  pixels.  This  can  be  accomplished  In 
an  optical  system  In  one  of  two  ways.  An 
optical  scanner  can  be  used  after  the  multi¬ 
channel  correlator  to  deflect  the  light  by  the 
appropriate  distance  for  each  Input  line. 
Alternatively  (and  In  most  cases  preferably)  a 
CCD  camera  can  be  used  to  detect  the  1-D 
correlations  and  then  shift  the  detected  signal 
by  transferring  the  charge  on  the  CCD.  The  full 
2-D  correlation  g(E.n)  is  formed  by  accumulating 
(summing  over  n)  the  shifted  1-D  correlation  on 
the  time  Integrating  detector  array.  The 
operations  that  must  be  performed  to  Implement 
this  algorithm  optically  are  summarized  In  the 
block  diagram  of  Figure  1. 


by 


HOLOGRAPH 1C  IMPLEMENTATION 

He  will  describe  this  Implementation  [3]  with 
the  aid  of  Figure  2.  The  input  pattern  Is  detected 
by  the  TV  camera.  The  horizontal  sync  of  the  camera 
Is  locked  to  a  stable  oscillator  which  acts  as  the 
master  clock  for  the  entire  processor.  Each  pulse 
from  this  oscillator  triggers  the’ TV  camera  to 
produce  an  electronic  signal  corresponding  to  one 
of  the  lines  In  the  Input  pattern.  The  video 
signal  Is  heterodyned  to  the  center  frequency  of 
the  AOD  and  after  amplification  It  Is  applied  to 
the  piezoelectric  transducer  of  the  AOD.  At  the 
end  of  each  horizontal  scan  by  the  TV  camera,  the 
acoustic  wave  In  the  AOD  Is  spatially  modulated 
by  the  corresponding  line  of  the  Input  pattern. 

The  clock  from  the  master  oscillator  is  delayed 
the  duration  of  one  raster  line  and  it  triggers 
the  pulsed  laser  that  Is  used  as  the  source  In 
this  processor.  The  duration  of  the  light  pulses 
Is  made  shorter  than  the  Inverse  of  the  bandwidth 
of  the  video  signal.  As  a  result  the  light 
diffracted  by  the  AOD  each  time  the  laser  is  pulsed 
is  spatially  modulated  by  one  of  the  lines  of 
the  input  pattern.  The  diffracted  light  enters 
an  astigmatic  lens  system  which  expands  and 
collimates  the  light  In  the  vertical  direction. 

In  the  horizontal  direction  the  light  is  Fourier 
transformed. A  1-D  Fourier  transform  hoi oqram  of  the 
reference  image  h(x,y)  In  our  notation  is  placed 
In  the  Fourier  plane  of  this  astigmatic  lens 
system.  The  hologram  contains  the  reference  Image 
transformed  In  the  x  direction  only.  Since  the 
light  Illuminating  the  hologram  is  collimated 
vertically,  the  light  diffracted  by  the  hologram 
Is  modulated  by  the  product  of  the  transform  of 
the  current  line  from  the  input  pattern  and  all 
the  lines  of  the  reference  Image.  A  second 
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Figure  1.  Block  diagram  of  the  acousto-optic  implementation  of  the  Image  correlator 


A  variety  of  specific  optical  Implementations 
are  possible  using  this  algorithm  and  the  trade¬ 
offs  Involved  do  not  make  one  of  the  implementa¬ 
tions  clearly  superior  to  the  rest  for  all 
applications.  In  this  paper  we  discuss  a  holo¬ 
graphic  implementation  that  shares  all  the  Charac¬ 
teristics  of  the  algorithm 

depicted  In  Figure  1:  the  Input  Image  Is  entered 
In  the  optical  system  via  the  TV  camera  and  the 
acousto-optic  device;  a  multi-channel  1-D  correla¬ 
tor  processes  each  line  of  the  Input  Image  and  a 
2-0  time  integrating  detector  Is  used  to  accumu¬ 
late  the  1-D  correlations  and  form  the  full  2-D 
correlation. 


astigmatic  lens  system  Is  placed  after  the  holo¬ 
gram.  The  light  Is  now  imaged  in  the  vertical 
direction  and  transformed  again  In  the  horizontal 
direction.  The  transform  of  the  product  of  the 
transforms  produces  the  correlation  (or  convolution 
If  desired)  between  one  of  the  Input  lines  and  all 
the  lines  of  the  reference  image.  The  imaging 
that  is  performed  In  the  vertical  direction  causes 
these  1-D  correlations  to  appear  stacked  in  the 
vertical  direction  at  the  output  plane  of  the 
optical  system.  Returning  momentarily  to  Eq.  (3), 
the  operation  that  has  been  performed  up  to  this 
point  in  the  processor  Is  the  1-D  Integral  of 
Eq.  (3).  A  2-D  CCD  detector  Is  placed  at  the  out¬ 
put  plane  of  the  processor.  The  photogenerated 
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Figure  2.  Acousto-optic/CCD  Image  correlator. 


2-0  charge  pattern  that  Is  stored  In  the  CCD  after 
It  Is  exposed  to  the  light  from  each  laser  pulse. 
Is  shifted  vertically  by  one  pixel.  If  me  trace 
the  location  on  the  CCD  of  the  charge  generated 
during  the  nth  light  pulse  we  find  that  after  the 
Nth  pulse  occurs.  It  has  travelled  N-n  pixels  In 
the  vertical  direction.  To  obtain  the  2-0 
correlation  we  must  (according  to  Eq.  (3))  shift 
the  nth  line  by  n  pixels.  Since  N  Is  fixed  (It  Is 
the  total  number  of  lines  In  the  Input  pattern) 
the  CCD  does  perform  the  appropriate  shifting  and 
the  entire  2-0  correlation  forms  (shifted  by  N 
pixels)  after  Integration  on  the  CCD  (the  suima- 
tlon  over  n  In  Eq.  3)  of  the  light  Incident  on  It 
from  N  light  pulses.  The  correlation  output  Is 
read-out  continuously  by  the  CCD  In  the  form  of  a 
video  signal  which  can  be  displayed  or  processed 
further  electronically. 

In  this  processor  the  1-0  correlations  that 
are  formed  at  the  output  of  the  optical  system 
modulate  the  amp! Itude  of  the  light.  This  optical 
wave  must  be  Tnter7erometr1cally  detected  In  order 
to  obtain  a  detected  signal  proportional  to  the 
field  amplitude  rather  than  Its  Intensity.  The 
Interferometric  detection  method  [4]  and  experi¬ 
mental  demonstration  of  It  [5]  have  been  discussed 
elsewhere.  In  this  paper  we  wish  to  concentrate 


on  the  2-0  operation  that  Is  being  performed  by 
the  processor  of  Figure  2,  when  Interferometric 
detection  Is  not  used.  In  this  Instance  the 
pattern  g'(?,n)  formed  on  the  CCD  Is  given  by  the 
following  expression  [4]: 


g'U.n)  •  l  I  / f(x,niy)  h  (x+E,  nAy+n)dx|2  (4) 
n-1  J 

The  function  g'U.n)  Is  similar  to  the  correla¬ 
tion  In  form.wlth  the  Important  exception  that  the 
1-D  correlations  In  the  x-dlrectlon  are  squared 
before  the  summation  In  the  second  dimension  Is 
performed.  This  operation  Is  clearly  non- linear 
but  It  Is  shift  Invariant.  Since  g'(C,n)  can  be 
very  conveniently  calculated  with  the  acousto¬ 
optic  Image  processor,  we  Investigated  Its  proper¬ 
ties  to  determine  Its  possible  utility  for  pattern 
recognition.  Using  the  Schwarz  Inequality  It  can 
be  shown  that 

g'  (C.n)  <  l  |J|  f(x.nAy)  |2  dx  \2  ^  G'  (5) 
n 

and  the  equality  holds  only  for  g "(C ."n )  *  G'.  This 
result  Is  significant  because  It  Indicates  that 
g'U.n)  Is  maximized  when  the  Input  and  the 
reference  Images  are  matched  and 
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aligned  spatially.  Therefore  It  could  be  used  to 
recognized  patterns.  We  must  however  consider 
the  performance  of  a  pattern  recognition  system 
based  on  this  operation,  when  noise  Is  present. 

A  full  analysis  of  this  case  Is  beyond  the  scope 
of  this  paper,  but  we  will  point  out  several 
Important  facts,  first,  the  slgnal-to-nolse 
ratio  analysis  that  Is  typically  performed  to 
determine  the  performance  of  pattern  recognition 
algorithms  that  are  based  on  correlation  Is  not 
appropriate  In  the  nonlinear  case.  The  non* 
linearity  In  g'  results  In  noise  components  at 
the  output  that  are  not  normally  distributed  and 
therefore  the  underlying  distribution  becomes 
Important  In  the  determination  of  the  probabll* 
Itles  of  detection  and  mlsclasslflcatlon.  Further¬ 
more,  patterns  that  belong  to  different  classes 
but  correlate  well  (and  therefore  are  likely  to 
be  mlsclasslfled  by  a  linear  correlation 
algorithm)  can  be  well  separated  by  the  non¬ 
linear  correlation,  and  vice-versa.  For 
Instance,  If 

G  ■  tj\  f(x.nAy)  |2  dx  .  (6) 

Is  the  value  of  the  autocorrelation  peak  of 
the  Image  f,  we  denote  by  «6  the  peak  value  of 
the  crosscorrelatlon  between  f  and  a  second 
Image  h(x,y)  not  belonging  to  the  same  class  as 
f.  a  Is  a  constant  satisfying  -1<a<1.  The  non¬ 
linear  crosscorrelatlon  of  the  same  two  functions 
Is  denoted  by  BG',  where  G'  Is  defined  In  Eq.  (5) 
and  6  Is  a  constant  satisfying  0<8<1.  It  can  be 
shown  [6]  that  given  a,  8  Is  In  the  range 
2  2 

a  <8<1  or  a  <8<a  If  the  Images  Involved  are  real 
and  positive.  Clearly  8  can  be  smaller  than  a, 
which  intuitively  Indicates  that  If  this  Is  the 
case  two  patterns  can  be  separated  more  effec¬ 
tively  with  the  non-linear  correlation  g'.  More 
formally,  we  calculate  the  probability  of  false 
alarm  (the  probability  of  classifying  h(x,y)  as 
belonging  to  the  class  represented  by  f(x,yj)  as 
a  function  of  the  parameter  8  for  the  non-linear 
correlation  case.  This  function  Is  plotted  In 
Figure  3  for  an  Input  SNR«1,  assuming  a  linear 
processing  gain  of  10,  a  value  of  a  •  .7  and  for 
a  fixed  probability  of  detection  Pg  ■  .96.  On 

the  same  diagram  the  probability  of  false  alarm 
that  we  obtain  under  the  same  conditions  using 
linear  correlator  Is  Indicated.  We  note  that  In 


Figure  3  there  Is  a  very  low  probability  of  false 
alarms  for  both  cases  (this  Is  a  somewhat  super¬ 
fluous  case  since  a  Is  relatively  low  and  the  SNR 
Is  high)  but  we  can  also  see  that  the  probability 
of  false  alarm  can  be  smaller  for  the  non-linear 
correlator.  Of  course  (t  can  also  be  higher 
depending  on  the  value  of  8.  8  Is  determined  by  the 
Images  f  and  h  and  therefore  we  conclude  from  this 
exercise  that  a  recognition  algorithm  based  on  non¬ 
linear  correlation  can  out-perform  the  linear 
correlator  for  a  certain  class  of  Images.  In 
general,  the  non-linear  correlation  can  provide 
adequate  performance  for  a  large  class  of  pattern 
recognition  applications.  A  complete  statistical 
characterization  of  the  non-linear  correlation  will 
be  presented  In  a  future  publication. 

EXPERIMENTAL  PROCESSOR 

A  photograph  of  the  experimental  acousto- 
optic/CCD  Image  correlator  Is  shown  in  Figure  4. 

The  apparatus  Is  a  hardware  Implementation  of  the 
system  shown  In  Figure  3.  The  light  source  used 
In  this  experiment  Is  a  pulsed  laser  diode  with 
SO  nsec  pulse  width.  The  Inverse  of  the  pulse 
width  (1/50  nsec  «  20  MHz)  must  be  at  least  twice 
the  video  bandwidth,  therefore  video  signals  with 
up  to  10  MHz  bandwidth  can  be  processed  with  the 
system.  The  peak  power  of  this  laser  can  be  as 
high  as9w,  resulting  In  an  average  light  power 
of  approximately  10  mW  which  Is  adequate  for 
detection  by  the  CCD.  A  custom  fabricated  acousto¬ 
optic  device  was  the  Input  electronlc-to-optlcal 
transducer.  This  device  is  a  shear  acoustic  wave 
TeO,  Bragg  cell,  with  30  MHz  IdB  bandwidth  at 
820  nm  (the  laser  wavelength).  In  excess  of  400%/ 
watt  diffraction  efficiency  and  most  significantly, 
the  acoustic  delay  of  the  device  Is  70  usee.  The 
long  acoustic  delay  Is  required  In  this  processor 
so  that  we  can  accommodate  an  entire  standard  video 
line  (63  usee).  The  light  diffracted  by  the  A0D 
Is  demagnlfled  by  a  factor  of  approximately  4  with 
two  spherical  lenses.  In  order  to  match  the  size  of 
the  video  lines  from  the  AOD  (4  cm)  with  the  size 
of  the  transparencies  used  to  fabricate  the 
hologram  (1  cm).  The  demagnlfled  Schlleren  Image 
of  the  AOD  Is  reflected  towards  the  hologram  and 
Fourier  transformed.  The  hologram  was  formed  from 
a  transparency  recorded  on  a  high  speed  holographic 
plate  (to  avoid  the  phase  distortion  Introduced  by 
the  plastic  substrate  of  film)  with  a  HeNe  laser. 
The  components  that  are  used  for  recording  the 
hologram  are  visible  In  the  far  end  of  the  optical 
bench  In  Figure  4.  The  holograms  are  recorded  on 
dichromated  gelatin  to  obtain  high  diffraction 
efficiency.  Ue  obtain  in  excess  of  20%  efficiency 
with  the  dichromated  gelatin  holograms  at  820  nm. 
The  light  diffracted  by  the  hologram  is  reflected 
towards  the  CCD,  Imaged  vertically  and  transformed 
horlzontlally.  The  CCD  used  In  the  experiment 
ts  a  commercially  available  (Fairchild)  1-D  device 
oriented  vertically.  Special  timing  and  driving 
electronic  circuits  were  built  to  operate  the 
device  In  the  tlme-delay-and-lntegrate  (TO!)  mode 
necessary  for  this  processor.  The  1-0  array 
produces  slices  of  the  2-0  correlation  surface  In 
the  n  direction,  for  a  fixed  C  value.  The  slices 


Figure  4.  Experimental 

for  different  £  values  can  be  observed  by  translat¬ 
ing  the  CCD  horizontally.  A  1-D  CCD  was  chosen 
for  this  initial  experiment,  rather  than  a  2-D  CCD 
which  can  produce  the  entire  2-D  correlation 
simultaneously,  because  Its  output  can  be  easily 
monitored  on  an  oscilloscope  which  has  allowed  us 
to  easily  align  and  calibrate  the  system.  The 
input  pattern  (shown  in  Figure  5a)  was  detected 
by  a  high  resolution  TV  camera  (not  shown  in 


Acousto-optic/CCD  image  correlator. 

Figure  4).  The  output  signal  from  the  CCD  for  5 
horizontal  positions  is  shown  in  Figure  5b.  This 
composite  photograph  is  the  2-D  autocorrelation 
of  the  pattern  in  Figure  5a  computed  by  the  system 
in  Figure  4.  Interferometric  detection  was  not 
used  in  these  experiments,  therefore  the  non-linear 
correlation  described  by  Eq.  4  is  obtained.  The 
pattern  in  Figure  5a  is  in  good  agreement  with  the 
autocorrelation  expected  from  the  simple  pattern 
in  Figure  5a.  Me  attribute  the  asynvnetries  notice¬ 
able  in  Figure  5b  to  non-linearities  and  phase 
distortion  in  the  hologram. 

ACKNOWLEDGMENTS 

The  research  reported  in  this  paper  is  sup¬ 
ported  by  the  Army  Research  Office  and  the  Air 
Force  Office  of  Scientific  Research. 

Me  thank  Dr.  Peter  Kellman  for  his  assistance 
In  the  design  of  the  acousto-optic  device  used  in 
the  experiments  and  Mr.  Ed  Roos  from  Crystal 
Technology  for  the  fabrication  of  the  device. 


*V- 


(■) 


(b) 

Fig.  5(a).  Input  Pattern  (b)  Optically  Computed 
Auto-Correlation 


REFERENCES 

[1]  Special  issue  on  Acousto-optic  Signal 
Processing,  Proc.  IEEE,  Vol .  69,  1,  Jan.  1981. 

[2]  K.  Bromley,  et.  al.,  Proc.  SPIE,  Vol.  118, 
p.  118,  1977 

[3]  D.  Psaltis,  J.  Opt.  Soc.  Am.,  71,  p.  198, 

1981 

[4]  0.  Psaltis,  Appl .  Opt.,  21,  p.  491  .  1982 

[5]  M.  Haney  and  0.  Psaltis,  this  volume. 

[6]  S.  Venkatesh  and  0.  Psaltis,  to  be  published. 


»r* 


-4 


Trmn 


U_P5H  H.'  ,.,A".V.  'JWJ.  LN  '.■»  v*  v  > 1 


1  PTTO rr^ ^  'A  LW.V'.V.T.VUTA’WV <-’V  .'<•  »-V  -  «  .y 

vivj 

-  ,v> 


Incoherent  electro-optic  image  correlator 
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Abstract.  A  real-time  optical  image  correlator  is  described.  An  acousto-optic 
device  and  an  array  of  light-emitting  diodes  are  the  electronic-to-optical  trans¬ 
ducers  for  the  input  and  reference  images,  respectively,  in  this  architecture. 
The  two-dimensional  correlation  is  formed  by  temporal  integration  on  a  two- 
dimensional  CCD  detector. 
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1.  INTRODUCTION 

Two-dimensional  correlation  and  convolution  is  one  of  the  most 
powerful  operations  that  can  he  performed  optically  and  is  useful  in  a 
wide  range  of  applications,  such  as  pattern  recognition,1-2  image 
restoration/ enhancement,1  and  synthetic  aperture  radar.4  The  clas¬ 
sical  implementation 1  of  an  optical  image  correlator  requires  2-D 
spatial  light  modulators  on  which  the  input  image  and  the  Fourier 
transform  hologram  of  the  Alter  function  are  recorded.  The  need  for 
high  performance  real-time  2-D  devices  has  restricted  the  applicabil¬ 
ity  of  optical  image  correlators  because  these  devices  are  generally 
difficult  and  expensive  to  fabricate.5-*  Furthermore,  the  holographic 
Alter  is  typically  recorded  on  a  photographic  plate  and  is  therefore 
Axed.  Image  correlators  can  be  implemented  by  multiplication  in  the 
spatial  frequency  domain  with  incoherent  light,7  and  this  can  be 
advantageous  because  speckle  and  other  coherent  artifacts  are  elimi¬ 
nated  while  at  the  same  time  the  need  for  high  quality  optical  devices 
is  eliminated.  The  relative  disadvantages  of  this  implementation  are 
inflexibility  in  designing  and  updating  the  Alter  and  the  strong  bias 
that  is  formed  in  addition  to  the  signal  at  the  output  of  the  processor. 
Rhodes*  has  introduced  a  method  for  image  correlation  in  which  the 
Fourier  transform  of  an  image,  recorded  as  a  2-D  optical  transpar¬ 
ency,  is  produced  in  the  form  of  a  temporal  electronic  signal  at  the 
output  of  a  single  detector.  The  Fourier  transform  of  the  Alter 
function  can  then  be  stored  or  produced  electronically  and  mul¬ 
tiplied  in  the  time  domain  with  the  transform  of  the  input.  The 
correlation  is  produced  by  retransforming  the  product  of  the  tem¬ 
poral  signals  back  to  the  2-D  space.  The  primary  advantage  of  this 
method  derives  from  the  fact  that  the  Alter  is  electronically  stored  or 
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generated  and  therefore  can  be  dynamically  programmed .  The  author 
has  recently  described*  10  an  optical  architecture  in  which  the  inpL-» 
image  is  entered  into  the  optical  processor  through  an  acousto-optic 
device  ( AOD)  in  the  form  of  a  video  signal  produced  by  a  TV  camera. 
The  Alter  is  stored  in  the  optical  system  as  a  l-D  Fourier  transform 
hologram,  and  the  2-D  correlation  is  formed  on  a  time-integrating 
CCD  detector  array  operated  in  the  time-delay-and-integrate  (TDI) 
mode."  The  use  of  the  AOD  as  the  input  transducer,  which  is  a 
well-developed  and  consequently  high  performance  and  practical 
device,12  is  the  most  attractive  feature  of  this  architecture.  The  fact 
that  the  Alter  is  stored  permanently  as  a  holographic  transparency 
restricts  its  applicability  to  problems  where  the  Alter  does  not  need  to 
be  updated  dynamically. 

In  this  paper  a  new  architecture  is  described  in  which  the  input 
transducer  is  also  an  AOD,  but  the  Alter  is  electronically  stored  and  is 
entered  into  the  optical  system  through  an  array  of  light-emitting 
diodes  (LEDs).  Therefore,  in  this  architecture  the  advantages  of 
having  a  high  performance  input  device  are  combined  with  the 
flexibility  of  electronic  storage  of  Alter  function. 

2.  DESCRIPTION  OF  THE  ARCHITECTURE 

A  schematic  diagram  of  the  architecture  is  shown  in  Fig.  I .  The  input 
scene  is  detected  by  a  TV  camera,  and  the  video  signal  is  applied  to 
the  AOD  in  Fig.  I .  The  reference  image  is  stored  in  a  digital  or  analog 
(CCD)  electronic  memory,  with  multichannel  readout  capability. 
The  data  are  stored  in  memory  in  a  way  that  allows  each  line  of  the 
reference  image  to  be  accessed  separately,  in  parallel.  The  signal  from 
each  channel  modulates  temporally  the  corresponding  element  of  the 
LED  array  in  Fig.  I .  If  a  digital  memory  is  used,  a  digital-to-analog 
converter  is  included  in  each  channel.  The  memory  is  read  out 
cyclically  in  synchronism  with  the  video  signal  fremt  the  TV  camera; 
at  the  beginning  of  each  horizontal  TV  scan,  the  readout  of  the 
memory  is  initiated.  The  optical  system  in  Fig.  I  is  a  multichannel 
time-integrating  correlator  that  forms  on  the  2-D  detector  the  corre¬ 
lation  between  each  of  the  signals  applied  to  the  LED  array  and  the 
signal  applied  to  the  AOD.  In  particular,  the  correlation  between  the 
current  video  line  and  all  the  lines  of  the  reference  image  is  formed 
and  stored  on  the  CCD  detector.  The  charge  stored  on  the  CCD  is 
transferred  vertically  by  one  pixel  during  the  blanking  interval  of  the 
TV  camera.  As  a  result,  the  correlation  between  the  current  video  line 
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and  a  particular  line  of  the  reference  image  is  added  to  the  correlation 
of  the  previous  video  line  and  the  adjacent  reference  line.  The  repeti¬ 
tive  occurrence  of  this  procedure  results  in  the  formation  of  the  full 
2-D  correlation  between  the  input  and  reference  images,  as  we  will 
presently  show.  This  architecture  is  suitable  for  the  correlation  of 
large  (103X I03  pixels)  input  images  with  a  relatively  smaller  refer¬ 
ence  image  ( I02  X 102)  due  to  practical  considerations  which  will  be 
discussed  further  in  a  subsequent  section.  In  applications  such  as 
pattern  recognition,  this  is  often  the  situation  we  encounter  we  are 
searching  for  a  relatively  small  object  in  a  large  scene. 

The  input  and  reference  images  are  denoted  by  f(a,0)  and 
h(a,0),  respectively,  where  (a,/})  are  continuous  variables.  In  this 
architecture  both  images  are  sampled  in  one  of  their  dimensions 
before  they  are  processed.  In  sampled  form  the  images  are  denoted 
by  f(a,n)and  h(a.m),  where  0<n<N  and  0<m<  M  are  integers 
that  indicate  the  “line  number. “  N  and  M  are  the  total  number  of 
lines  of  the  input  and  reference  images,  respectively.  We  assume  that 
both  functions  f  and  h  are  real,  bipolar  with  zero  mean,  f  is  originally 
an  intensity  distribution  and  therefore  positive.  When  it  is  converted 
to  an  electronic  video  signal,  the  dc  component  can  be  removed  by  ac 
coupling  or  some  other  type  of  filtering.  A  bias  is  added  to  the  video 
signal.  The  bias  is  equal  to  the  maximum  negative  value  of  f.  For 
convenience  all  signals  will  be  normalized  to  unity,  and  therefore  a 
bias  level  of  one  is  added.  The  square  root  of  the  biased  video  signal  is 
formed  with  an  appropriate  electronic  circuit,13  and  the  signal  is 
heterodyned  to  the  appropriate  center  frequency  and  applied  to  the 
AOD.  For  small  diffraction  efficiencies,  the  amplitude  of  the  light 
diffracted  by  an  AOD  is  proportional  to  the  voltage  applied  to  the 
device.  The  intensity  of  the  diffracted  light  is  then  proportional  to  the 
voltage  squared.  The  square  root  operation  allows  a  linear  mapping 
of  the  video  signal  to  light  intensity.  There  are  other  methods  for 
linear  acousto-optic  light  intensity  modulation1419;  however,  the 
method  we  describe  here  is  the  simplest  and  is  well  suited  to  this 
architecture  since  we  do  not  require  complex  signal  processing  (only 
bipolar).  The  intensity  modulation  introduced  by  the  AOD  can  be 
written  as  follows: 


1 1  (t ,  t)  =  rect 


•fci] 

P  1  1  p  +  T  “  T ,  /  2  "| 

[j  +  jfO  +  r.njJrect^ - - - J 


where  r  =  x/v,  v  is  the  acoustic  velocity  in  the  AOD,  x  is  the 
horizontal  spatial  dimension,  T-is  the  acoustic  delay  in  the  AOD,  T, 
is  the  duration  of  each  horizontal  TV  scan,  and  the  origin  of  the  x  (or 
r)  axis  is  taken  to  be  at  the  transducer  of  the  AOD.  The  origin  of  the 
time  axis  is  reset  to  zero  at  tjie  beginning  of  each  horizontal  scan. 
Formally,  t  =  f  —  n(T,  +  T3),  where  T3  is  the  blanking  interval  (the 
time  that  elapses  between  the  end  of  a  horizontal  scan  and  the  start  of 
the  next  one),  and  f  is  the  continuous  time  variable. 

The  reference  image,  which  is  stored  in  an  electronic  memory, 
modulates  the  array  of  LEDs  in  Fig.  I.  Each  line  of  the  reference 
image  modulates  in  time  a  separate  LED.  The  modulation  is  repeti¬ 
tive;  after  T ,  seconds  have  elapsed  from  the  start  of  each  horizontal 
scan  of  the  TV  camera  (i.e.,  at  the  end  of  each  horizontal  scan),  the 
memory  is  triggered  to  start  reading  out  in  parallel  the  M  lines  of  the 
reference.  The  intensity  modulation  of  the  LEDs  is  given  by 
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Fig.  1 .  Incoherent  electro- optic  image  correlator. 


starts  the  next  horizontal  scan.  The  index  m  in  Eq.  (2)  designates  the 
different  lines  of  the  reference  image.  Since  there  is  a  one-to-one 
correspondence  between  these  lines  and  the  LEDs  that  are  stacked  in 
the  vertical  direction,  the  index  m  also  designates  the  position  in  the 
vertical  direction. 

The  LED  array  is  imaged  onto  the  AOD  in  the  vertical  direction 
by  the  combination  of  the  cylindrical  lenses  L,  and  L3.  This  imaging 
system  has  adequate  demagnification  so  that  the  image  of  the  LED 
array  is  smaller  than  the  height  of  the  transducer  of  the  AOD.  In  the 
horizontal  direction  the  light  emitted  from  each  LED  is  expanded 
and  collimated  by  lens  L2  to  illuminate  the  AOD  at  the  Bragg  angle. 
The  combination  of  the  spherical  lens  L4  and  the  cylindrical  lens  L6 
images  the  AOD  onto  the  output  plane,  where  a  2-D  CCD  detector  is 
placed .  The  undiffracted  light  is  blocked  at  the  focal  plane  of  lens  L4, 
and  only  the  light  diffracted  by  the  AOD  reaches  the  detector.  I  n  the 
vertical  direction,  lenses  L4  and  L5  also  image  the  AOD  onto  the 
output  plane.  The  use  of  cylindrical  optics  allows  us  to  set  the 
magnification  such  that  each  LED  is  imaged  onto  a  separate  row  of 
the  CCD.  Again,  there  is  a  one-to-one  correspondence  between  the 
LED  array  and  the  rows  of  the  CCD.  and  therefore  the  integer  m  also 
indicates  the  row  number  of  the  CCD.  The  charge  that  is  photo¬ 
generated  on  the  CCD  as  a  function  of  horizontal  position  rand  row 
number  m  during  the  nth  scan  of  the  TV  camera  is  proportional  to 
the  time-integrated  intensity  incident  on  it: 


C(r, m.n) 


l2(t .  m)  1,  (l ,  r)dt 


l2(t,m)  =  rect 


p-T,  ~T2/2]fl  I  1  [r-f|  [,-lL+rl  [t-T.-f 

[  T2  J  j_2  +  2  Ti’m)J  (2)  =  rect  — —  J  rect  - - -  rect  - - - 


T2  is  the  duration  of  each  line  of  the  reference  image.  Since  this 
processor  is  designed  to  correlate  relatively  small  reference  images, 
T2  will  be  much  smaller  than  T, .  The  blanking  interval  T 3  is  set  equal 
to  T2  so  that  the  reference  is  fully  read  out  before  the  TV  camera 


X  Q  +  ^  f(l  +  r,n)j  Q  +  ^  h(t  -  T,.m)j  dt 
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We  require  that  T>T,  +  T2,  i.e.,  the  aperture  of  the  AOD  is 


sufficiently  long  to  allow  the  input  and  reference  signals  to  interact 
fully.  We  assume  for  the  rest  of  this  discussion  that  T  =  T|  +T2. 
Equation  (3)  can  be  rewritten  in  a  simpler  form  by  combining  all  the 
rect  functions  with  the  limits  of  integration,  as  follows: 


n)  =  f  [^  +  ^f(t  +  r,n)J  [j  +  ^  h(t,m)J  dt 


C(r,m, 


1  + 


u 


T,+T, 


f(t  +  r.n)  h(t,m)  dt 


(4) 


In  the  last  equation  we  made  use  of  the  assumption  that  f(t,n)  and 
h(t .  m)  have  zero  mean.  The  photogenerated  charge  pattern  is  trans¬ 
ferred  vertically  on  the  CCD  by  one  row  after  the  completion  of  each 
horizontal  TV  scan.  The  charge  that  accumulates  in  the  last  (Mth) 
row  of  the  CCD  after  the  nth  scan  is  the  sum  of  charges  that  were 
generated  during  the  M  —  I  previous  scans  in  other  rows  of  the  CCD 
in  addition  to  the  charge  generated  during  the  current  scan: 


MT, 


C(r,n)  = 


1  + 


MT, 


i  =  M-t  /-+T« 

X  S  /  f(t  +  r.n  -  i)  h(t,M  -  i)  dt 


i=0 


MT, 


(5) 


1  + 


MT, 


T,+Tj 


n  =n  r 

£  /  f(t  +  r,nO  h(t,n'  +  M  -  n)  dt 

n'  =  n-M  +  1  j 


where  i  is  an  integer,  and  n'  =  n  —  i.  C(  r ,  n)  is  the  signal  that  forms  at 
the  last  row  of  the  CCD  after  the  nth  line  of  the  input  image  has  been 
processed.  This  signal  is  transferred  to  a  CCD  stage  that  transfers  the 
charge  horizontally  for  sequential  readout.  The  output  signal  is  the 
sum  of  a  bias  term  and  the  2-D  correlation  between  f  and  h.  The  2-D 
correlation  is  displayed’as  a  function  of  r  (horizontal  position)  and 
the  TV  line  number  n.  For  instance,  if  a  sharp  correlation  peak  is 
obtained  at  r  =  t0  after  the  nQth  line  has  been  processed,  we  conclude 
that  the  input  image  contains  an  object  matched  to  the  reference  h 
and  centered  at  r  =  r0  in  the  horizontal  direction  and  at  the(n_  —  M) 
TV  line. 


3.  DYNAMIC  RANGE  CONSIDERATIONS 


The  architecture  described  above  is  implemented  with  incoherent 
light.  In  incoherent  systems,  bipolar  numbers  cannot  be  directly 
represented  since  the  signals  that  are  processed  modulate  the  light 
intensity.  T o  overcome  this  difficulty,  the  signals  are  set  on  a  bias.  In 
certain  architectures,  particularly  if  complex  numbers  must  be  pro¬ 
cessed.  the  data  are  also  on  temporal  and/  or  spatial  carriers. I‘1’  In 
this  case  only  a  bias  is  necessary  since  in  image  processing  and 
pattern  recognition  both  the  input  and  reference  functions  are  gener¬ 
ally  real.  The  bias  permits  bipolar  images  to  be  represented,  a  crucial 
requirement  in  pattern  recognition  where  the  reference  image  must 
be  bipolar  to  provide  adequate  discrimination  between  different 
classes  of  objects.  The  insertion  of  bias  at  the  inpqt  stage  results  in  the 


014  /  OPTICAL  ENGINEERING  /  January/February  1994  /  Vol  23  No  1 


>.S> 


y, /.  A  /  .A  * ,  '  . 


formation  of  a  bias  on  the  detector.  As  a  result,  the  dynamic  range  of 
the  system,  DR'  (defined  as  the  ratio  of  the  maximum  signal  level  to 
the  minimum  detectable  change  in  the  signal),  is  reduced  since  a 
portion  of  the  detector  dynamic  range,  DR.  is  allotted  to  the  bias: 


DR'  =  DR 


j  SBR  \ 
\1  +  SBR  /  ’ 


(6) 


where  SBR  is  defined  as  the  ratio  of  the  peak  value  of  the  output 
signal  to  the  bias.  We  assume  without  loss  of  generality  that  the 
signal  attains  its  maximum  value  at  r  =  0,  n  =  M  [see  Eq.  (S)].  From 
Eq.  (5)  we  find  the  SBR  to  be 


SBR  = 


MT, 


n'=n 

2 


T,+T, 


n'  =  n  — M  +  l 


/ 


f(t.n')  h(t.n')  dt  . 


(7) 


Since  both  functions  f  and  h  are  normalized  to  unity  (0<|f|  <1, 
0  <|  h|  <  I),  the  SBR  is  bounded  in  therangeO<SBR  <  I.  The  upper 
limit  of  unity  can  be  achieved  only  when|f(t,n')  h(t,n')|  —  1  for  all  t 
and  n'.  A  more  typical  value  is  SBR  =  1/2,  which  is  obtained 
approximately  when  h  is  the  combination  of  a  whitening  filter  fol¬ 
lowed  by  a  matched  filter.  The  dynamic  range  of  the  CCD  is  approx¬ 
imately  I03: 1 .  As  an  example,  we  calculate  DR' to  be  equal  to  333:1 
for  SBR  =  1  /  2.  This  dynamic  range  is  adequate  for  detecting  reliably 
the  correlation  peak  against  the  noise  background.  In  many  applica¬ 
tions,  however,  the  input  object  f  is  contaminated  by  additive  inter¬ 
ference,  which  we  will  denote  by  g(t ,  n).  g  can  be  broadband  noise  or 
other  objects.  We  denote  by  k  the  ratio  of  the  peak  value  of  g  to  the 
peak  value  of  f.  If  g  is  a  stochastic  process,  its  peak  value  is  taken  to  be 
one  standard  deviation: 


_  m*x|g) 

max  (fi 


(8) 


The  normalized  signal  applied  to  the  AOD  is  now  given  by 

l2  +  WTn  [«*.»>  +  *<*.«>]  •  w 


Substituting  the  above  in  Eqs.  ( 1 )  through  (5).  we  obtain  the  follow¬ 
ing  expression  for  the  peak  value  of  the  output  correlation: 


C(r  =  O.n  =  M)  = 


MT, 


I  + 
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(k  +  l)MT2 
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f(t,n')h(t,n')dt 
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(10) 


The  first  term  in  the  above  summation  is  the  bias.  The  second  term  is 
the  signal,  and  the  maximum  value  it  can  attain  is  a/(k  +  I),  where 
0  <|  a|  <  I  according  to  our  previous  discussion.  The  third  term  is  the 
filtered  interference  signal,  and  its  maximum  value  is  k  (k  +  I).  If  k  is 
large,  the  interference  that  filters  through  to  the  output  can.  in 
principle,  be  approximately  equal  to  one.  in  pattern  recognition, 
however,  the  filter  h  is  chosen  to  enhance  only  selected  objects 
contained  in  f.  and  therefore  the  interference  term  is  suppressed  by  a 
factor  approximately  equal  to  the  square  root  of  the  space-band- 
width  product  of  the  filter.  Thus,  this  term  is  treated  as  a  noise 
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contribution  to  the  output  that  reduces  the  detector  dynamic  range 
but  does  not  significantly  affect  the  bias.  The  system  dynamic  range 
in  this  case  is  given  by 


DR'  = 


(I  +  Oj/oj)  (a  +  k  +  1) 


where  ax  and  od  are  the  standard  deviations  of  the  filtered  interfer¬ 
ence  and  the  detector  noise,  respectively.  In  the  absence  of  interfer¬ 
ence  Oj=0 and  k  =0,  and  Eq.  (1 1)  reduces  to  Eq.  (6).  In  the  presence 
of  additive  interference,  however,  DR'  is  reduced  significantly.  Let  us 
consider  a  specific  example.  We  will  take  a  =0.5  and  DR  =  1 03: 1  (od 
=  I0-3),  as  before,  and  we  will  set  k  =  10  and  ax  =  10-J.  The  value  for 
o,  is  calculated  by  assuming  the  processing  gain  of  the  correlator  to 
be  50.  For  this  case  DR'  is  found  to  be  equal  to  3.95: 1.  This  is  barely 
adequate  for  reliable  detection  of  the  correlation  peak.  This  example 
demonstrates  that  the  bias  buildup  that  unavoidably  occurs  from  the 
use  of  incoherent  light  can  result  in  an  unacceptable  loss  in  perfor¬ 
mance.  In  most  pattern  recognition  applications,  however,  the  value 
of  k  =  10  used  in  the  example  is  not  typical.  Usually  the  objects  that 
are  encountered  are  not  so  deeply  buried  in  the  noise.  A  value  of  k  =  1 
is  closer  to  what  is  usually  encountered  in  practice,  and  this  corre¬ 
sponds  to  a  system  dynamic  range  well  over  100:1.  This  dynamic 
range  is  sufficient  for  reliable  detection,  and  therefore  the  incoherent 
correlator  described  in  this  paper  is  applicable  for  pattern  recogni¬ 
tion  problems  provided  the  input  signal-to-noise  ratio  is  not  exceed¬ 
ingly  small. 

4.  DISCUSSION 

The  optical  correlator  originally  proposed  by  Vander  Lugt1  for 
image  recognition  is  a  matched  filter.  In  other  words,  the  reference 
image  is  a  replica  of  the  object  to  be  recognized.  A  matched  filter  is 
optimum  only  for  the  detection  of  this  one  object  in  the  presence  of 
white  noise.  Matched  filtering  is  generally  too  sensitive  to  geometri¬ 
cal  distortions  (scale,  rotation)  and  does  not  optimally  discriminate 
against  objects  ‘hat  do  not  belong  to  the  class  of  interest.  The 
performance  oi  an  optical  pattern  recognition  system  can  be 
improved  by  enhancing  the  high  spatial  frequencies  of  the  refer¬ 
ence,"  using  multiple  filters,"  or  synthesizing  an  optimum  filter  with 
information  collected  from  a  training  set  of  objects.10- 22  All  of  these 
techniques  have  been  previously  demonstrated  by  optical  synthesis 
of  appropriate  Fourier  transform  holograms  or  by  computer-gener¬ 
ated  holography.  The  electronic  storage  of  the  reference  image  in  the 
architecture  presented  in  this  paper  provides  the  flexibility  for  com¬ 
puting  accurately  the  reference  function  with  a  digital  computer  that 
is  interfaced  to  the  memory  in  which  the  reference  is  stored.  Thus,  the 
reference  can  be  updated  periodically  by  the  digital  computer,  and 
perhaps  more  importantly,  the  computer-generated  reference  can  be 
accurately  represented  in  the  optical  system.  The  electronic  memory 
can  be  either  a  recirculating  CCD  analog  memory  or  a  digital 
memory.  If  a  digital  memory  is  used,  an  array  of  digital-to-analog 
converters  is  incorporated  at  the  interface  of  the  memory  to  the  LED 
array.  LED  arrays  can  be  built  either  monolithically23  (on  a  single 
chip)  or  by  stacking  individual  LEDs.  In  either  case  the  size  of  such 
an  array  that  is  presently  feasible  is  not  more  than  100  elements.  An 
array  of  32  or  64  elements  is  possible.  Laser  diode  arrays  can  also  be 
used.  Laser  diodes  have  better  linearity  than  LEDs,  but  the  threshold 
current  and  the  infrared  wavelength  of  laser  diodes  are  relative 
disadvantages.  Several  monolithic  laser  diode  arrays  have  also  been 
fabricated.24  25  If  a  64  element  LED  array  is  used,  the  reference 
memory  must  store  64  X  64  pixels.  Fora  digital  memory  with  8  bits  of 


accuracy  in  each  pixel,  this  corresponds  to  a  total  of  32  kbits  of 
memory.  The  contents  of  the  memory  must  be  read  out  at  a  rate  equal 
to  the  bandwidth  of  the  video  signal.  For  an  input  image  with 
512X512  resolution  elements  processed  at  30  frames  per  second,  this 
rate  is  7.8  MHz  or  127  ns  per  sample.  Both  digital  memories  and 
CCDs  can  be  read  out  at  this  rate.  The  acoustic  delay  of  the  AOD 
must  be  equal  to  the  duration  of  each  raster  line  (50  its  excluding  the 
blanking  interval)  plus  the  duration  of  each  line  of  the  reference  (5 
Its).  TeOj  devices  can,  in  principle,  be  fabricated  with  up  to  100  its 
acoustic  delay.26  We  have  tested  in  our  laboratory  TeOj  devices  with 
up  to  70  its  delay.  Finally,  the  CCD  must  have  512  +  64  =  576  pixels 
in  the  horizontal  direction  and  64  pixels  in  the  vertical  direction.  The 
CCD  is  read  out  at  standard  video  rates  (7.8  MHz)  also.  These 
requirements  can  be  satisfied  with  CCDs  that  are  available 
commercially. 

The  advanced  state  of  the  art  of  the  components  used  in  this 
architecture,  which  can  lead  to  the  implementation  of  practical 
(power  efficient,  compact,  inexpensive)  processors,  and  the  flexibil¬ 
ity  provided  by  the  electronic  storage  of  the  reference  are  the  most 
attractive  features  of  this  approach.  The  limited  dynamic  range  that 
results  because  incoherent  light  is  used  in  the  implementation  and  the 
relatively  small  size  of  the  reference  image  that  is  a  consequence  of 
device  (LED  array)  limitations  are  limitations  that  are  inconsequen¬ 
tial  for  a  majority  of  pattern  recognition  applications. 
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l.  INTRODUCTION 

Synthetic  apenure  radar  (SAR)  still  represents  the  most  successful 
application  of  optical  computing,  even  though  more  than  30  years 
have  elapsed  since  the  initial  demonstration  of  the  optical  SAR  pro¬ 
cessor.  Optical  computers  are  used  routinely  today  to  form  SAR 
images  from  radar  signals  that  are  collected  by  aircraft  or  spacecraft 
and  recorded  on  photographic  film.  The  requirements  of  modern 
radars,  however,  are  often  not  met  by  the  present  film-based  optical 
processors.  These  requirements  include  higher  image  quality  (resolu¬ 
tion.  dynamic  range,  artifacts,  etc.),  real-time  image  formation,  flexi¬ 
bility.  and  on-board  processing  capability.  In  order  to  meet  such 
requirements,  digital  computers  are  increasingly  being  used  to  form 
SAR  images.  The  dramatic  advances  in  microelectronics  in  recent 
years  have  made  it  feasible  to  construct  digital  SAR  processors  that 
can  provide  better  image  quality  (due  to  the  highest  accuracy  and  the 
flexibility  in  programming  a  digital  computer)  than  film-based  SAR 
processors.  In  addition,  digital  processors  can  be  built  (as  they  have  in 
some  cases)  that  have  real-time  and  on-board  processing  capabilities. 
It  is  not  the  purpose  of  this  paper  to  present  a  comparison  of  optical 
versus  digital  techniques  in  SAR  (the  interested  reader  is  referred  to 
Ausherman's  paper1),  but  it  is  necessary  to  point  out  that  a  number  of 
problems  remain  with  digital  SAR  processors.  The  complexity  of 
these  systems  results  in  a  very  costly,  power  consuming,  relatively  large 
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and  heavy  processor.  Thus,  even  though  it  is  conceivable  to  build  a  low 
resolution  real-time  digital  processor,  for  many  of  the  applications  this 
is  an  impractical  solution. 

Very  significant  advances  have  also  been  achieved  in  the  area  of 
electro-optics  which  have  resulted  in  corresponding  improvements 
in  the  state  of  the  art  of  optical  computers.  Specifically,  acousto¬ 
optic  technology  has  matured,  and  consequently  high  quality  de¬ 
vices  are  now  available  to  be  used  as  the  input  spatial  light  modulator; 
semiconductor  detector  arrays(CCD‘s  and  photodiode  arrays)  have 
proven  to  be  excellent  as  detectors  in  the  optical  computer,  and  the 
semiconductor  light  sources.  (LED's  and  laser  diodes)  which  have 
been  developed  primarily  for  optical  communications,  are  a  very 
efficient  light  source  in  many  optical  processors.  These  and  other 
developments  have  made  it  possible  to  construct  real-time,  high 
performance,  power  efficient,  compact  and  relatively  inexpensive 
optical  computers  such  as  the  acousto-optic  spectrum  analyzer2  and 
the  ambiguity  function  radar  processors.1  In  this  paper  we  describe 
an  optical  SAR  processor  in  which  the  modern  components  avail¬ 
able  for  optical  computing  are  fully  utilized,  and,  therefore,  we 
believe  that  the  resulting  processor  has  great  potential  for  applica¬ 
tions  where  on-board,  real-time  SAR  image  formation  is  required. 

in  Sec.  2  the  fundamentals  of  SAR  are  reviewed,  in  order  to 
establish  the  notation  we  will  be  using  in  the  paper.  A  comprehensive 
treatment  of  SAR  can  be  found  in  Refs.  4  and  5.  In  Sec.  3  the 
operation  of  the  optical  processor  is  described  in  detail,  and  in  Sec.  4 
we  discuss  its  performance  characteristics.  Our  experimental  results 
to  date  are  reported  in  Sec.  5. 

2.  SAR  SIGNALS 

The  side-looking  SAR  geometry  is  depicted  in  Fig.  I.  The  vehicle 
(aircraft  or  spacecraft)  is  traveling  with  a  constant  velocity  v  along 
the  t)  direction  and  at  height  h.  Coded  pulses  are  emitted  periodically 
through  an  antenna  mounted  on  the  side  of  the  vehicle.  In  this  paper 
we  assume  that  the  pulses  are  chirp  coded.  The  transmitted  wave¬ 
forms  S(t)  in  complex  notation  is  given  by  , 

S(t)  =  £  rect  [■"““]  exp[jb(t-nT)2]exp(j27rv0t)  ,  (1) 

n 

where  r  is  the  pulse  duration.  I  /  T  is  the  pulse  repetition  frequency 
(PRF).  b  is  the  chirp  rate,  and  vQ  is  the  microwave  frequency  of  the 
radar.  The  transmitted  waveform  illuminates  a  patch  of  the  surface 
to  be  imaged  (the  ground),  and  part  of  it  is  reflected  back  towards  the 
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Fig.  1 .  Synthetic  aperture  radar  geometry. 


vehicle  and  detected  by  the  antenna.  The  objective  of  SAR  is  to  form 
an  image  of  the  ground  from  these  reflections.  We  will  discuss  how 
an  image  of  a  single  point  scatterer  (impulse)  located  at  coordinates 
f  =  f0  and  rj  =  »j0  on  the  ground  can  be  formed.  Since  the  SAR  image 
formation  is  a  linear  operation,  knowledge  of  the  impulse  response 
completely  describes  the  system.  The  signal  received  by  the  antenna 
due  to  a  single  point  scatterer  is 

r(t)  =  A(t)S(t  — 2R/c)  .  (2) 

where  R  is  the  instantaneous  range  from  the  antenna  to  the  point 
scatterer  at  (fG ,  tj0).  A(t)  is  the  far-field  pattern  of  the  antenna.  From 
the  geometry  of  Fig.  I ,  R  can  be  written  as 


R(0  =  S(v0-v  I2  +  R02  = 


vt)2  +  Rc2 


where  R0  =  i/h2  +  (02  is  the  range  when  the  vehicle  crosses  rj  =  ?j0. 
In  most  cases,  the  variation  of  the  range  R(t)  with  time  can  be 
neglected  within  the  duration  r  of  a  single  radar  pulse,  and  therefore 
R(t)  —  R(nT).  In  addition,  the  range  R0  is  typically  much  greater 
than  the  distance  |  >7  —  i?0l .  This  allows  us  to  expand  the  square  root 
in  Eq.  (3)  as  follows: 

(vnT--  tJq)2 

R(t)  =  R(nT)  =  R0  + - — -  (4) 

•iKo 

Using  the  above  equation  and  Eq.  ( I ),  we  can  rewrite  Eq.  (2)  as 

[t  —  2R0/C  —  At  —  nT  1 

- t - J 

X  exp[jb(t  —  2R0/c  —  At  —  nT)2] 

X  exp(j2jrv0t)exp(-j2»rv0  2R0/c)exp(-j2»rv0Ar)  (5) 

The  variation  of  the  antenna  pattern  A(t)  during  a  single  pulse  can  be 
neglected,  and  hence  A(t)  —  A(nT).  The  quantity  At  =  (vnT  — 
i70?  R0£  has  units  of  time  and  is  very  small  compared  to  2R„/c  if 
R0»|i7-7J0|  Therefore,  At  can  be  neglected  in  Eq.  (5)  except  in 
the  term  exp(— j2 n\0Ar)  because  in  this  term  At  is  multiplied  by  v0 
which  is  the  very  large  radio  frequency.  The  term  exp(  -j4  jtv0  R0/  c) 
is  an  inconsequential  constant  phase  term  and  Can  be  omitted.  With 
these  modifications,  we  can  write  the  final  form  forr(t)  as 


Fig.  2.  Aeouato-optic/CCD  synthetic  aperture  radar  processor  (LS— 
light  aourca.  AOD— acousto-optic  device.  F,  is  the  focal  length  of  the  Ians 
Li,  and  the  broken  linos  indicate  the  path  of  the  rays  of  the  reference 
wave) 

[  t  -  2R0  c  -  nT  I 

r(t)  *  2)  A(nT)  re£l  - - J 

X  exp[jb(t-2R0/c  -  nT)2]  exp[-j(2»rv0  cR0)  (vnT-tj,,)2] 

X  exp(j2rrv0t)  _  (6) 

The  received  signal  r(t)  must  be  processed  to  produce  an  image  of  the 
point  scatterer  on  the  ground.  In  the  next  section  we  will  describe  in 
detail  how  the  real-time  optical  processor  that  is  presented  in  this 
paper  forms  the  SAR  image  from  the  signal  r(t).  In  deriving  Eq  (6).  a 
number  of  simplifying  assumptions  and  approximations  were  made, 
which  may  or  may  not  be  justifiable  in  practice  depending  on  the 
particular  application.  We  will  proceed  with  the  description  of  the 
system  based  on  this  relatively  simple  form  of  the  SAR  equation  [Eq. 
(6)],  and  in  Sec.  4  we  will  discuss  the  necessary  modifications  to  the 
system  for  cases  in  which  the  conditions  set  in  this  section  are  not  met. 

3.  ACOUSTO-OPTIC/CCD  SAR  PROCESSOR 

A  schematic  diagram  of  the  processor  is  shown  in  Fig.  2.  The  system 
is  illuminated  by  a  pulsed  laser.  The  light  amplitude  of  the  source  is 
modulated  by 

1 

P(t)  =  £  reel  p  "  1  •  (7) 

n  L  r°  J 

where  r0  is  the  duration  of  each  light  pulse  The  spherical  lens  L, 
collimates  the  light  from  the  source,  and  the  cylindrical  lens  L, 
focuses  the  light  in  the  vertical  (y)  direction  so  that  it  can  pass 
through  the  aperture  of  the  acousto-optic  device  (AOD)  placed  in 
plane  Pt.  The  received  radar  signal  r(t)  is  heterodyned  to  the  center 
frequency  v,  of  the  AOD.  and  a  reference  signal  Bexp(j2irv:t)  is 
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added  to  it.  The  frequency  v2  is  chosen  such  that  the  difference  v2  — 
v,  is  equal  to  the  bandwidth  of  each  radar  pulse: 

v2  -  v,  =  br/  it  .  (8) 

The  need  for  the  reference  signal  will  become  apparent  shortly.  The 
resulting  signal  r’(t)  is  related  to  r(t)  by  the  following  equation: 

r'(t)  =  r(t)exp[-j2»r(v0  -  v,)t]  +  Bexp(j2irv2t)  .  (9) 

r'(0  is  applied  to  the  piezoelectric  transducer  of  the  AOD  of  Fig.  2. 
The  light  diffracted  by  the  AOD  is  modulated  by* 

Sj(l,x)  -  rect  (-£-)  P(t)  r'  (t  +  •  (10) 


x  cos  p«r(S_vl>I  +  (vnT  _  %)2  + 

+  bias  terms  .  (14) 

The  derivation  of  Eq.  (14)  is  straightforward  but  tedious,  and  it  is 
presented  in  Appendix  A.  This  charge  pattern  gets  shifted  along  the 
y  direction  by  (N  —  n)  pixels  on  the  CCD,  after  N  exposures  have 
taken  place.  The  total  charge  that  accumulates  at  each  pixel  located 
at  coordinates  (x.y)  after  N  exposures  is  ■ 

N 

Q(*.y)  =  X  Q  [*.y+(N-n)Ay,n] 


where  x  is  along  the  direction  of  propagation  of  the  acoustic  wave,  X  is 
the  aperture  of  the  AOD,  and  vQ  is  the  speed  of  sound  in  the  AOD.  The 
undiffracted  light  is  blocked  in  the  focal  plane  of  the  cylindrical  lens 
Lj.  The  combination  of  lenses  L3  and  Lj  accomplishes  two  tasks.  First, 
since  the  two  lenses  are  separated  by  the  sum  of  their  focal  lengths,  a 
single  plane  wave  incident  on  L3  will  be  recollimated  when  it  exits  the 
lens  Lj.  In  addition,  the  impulse  response  of  the  system  in  the  x 
direction  from  plane  P,  to  plane  P2  is  made  to  be  equal  to 


Bvo  TTo  . 
— - -  sine 

x  (y  -  v0 


sine 


2Nvqv2T2 

cAyR0 


rru0x  +  <p] 


+  bias  terms  . 


(15) 


h(x.x)  =  exp[jb,(x-x)2]  exp(-j2irv,x/v0)  ,  (11) 

where  x  is  the  horizontal  coordinate  in  plane  P2.  The  constant  b,  can 
be  set  by  appropriately  choosing  the  focal  lengths  of  L3  and  L}  and 
the  distanced.  The  term  exp(— j2rrv(  x/v^)  reflects  the  fact  that  the 
optical  system  following  the  Bragg  cell  is  tilted  so  that  its  optical  axis 
coincides  with  a  wave  diffracted  at  the  Bragg  angle.  In  Eq.  (1 1)  we 
assume  that  the  effects  of  the  lens  apertures  are  negligible.  In  the 
vertical  direction  y,  the  light  is  recollimated  by  the  lens  L4,  and 
therefore  the  amplitude  of  light  entering  plane  P2  does  not  vary 
along  y.  At  P2  a  transparency  is  placed  immediately  in  front  of  the 
CCD  camera.  The  intensity  transmittance  T(x,y)  of  this  mask  is 

I  1  r  b/y2 1 

T(x,y)  =  -  +  -  cos  2rru0x  +  -s—  •  (12) 

where  u0  and  b2  are  constants  that  will  be  specified  later.  The 
instantaneous  intensity  incident  on  the  CCD  is  given  by 


Kx.y.t)  =  T(x,y) 


(t,x)  h(x,x)  dx 


(13) 


The  CCD  is  operated  in  the  shift-and-add  mode.7  In  this  mode  of 
operation  the  device  is  exposed  to  light  periodically.  The  photogen¬ 
erated  charge  is  accumulated  on  the  detector  fora  short  time  inter¬ 
val.  and  after  each  exposure  the  entire  photogenerated  charge 
pattern  is  electronically  shifted  by  one  pixel  along  one  of  the  dimen¬ 
sions  of  the  CCD.  The  photogenerated  charge  due  to  the  next 
exposure  is  simply  added  to  the  charge  that  is  already  stored  in  each 
pixel,  and  then  the  process  is  repeated.  In  our  system  the  charge 
transferring  is  done  in  synchronism  with  the  PRF  of  the  radar,  and 
the  integration  period  is  set  equal  to  the  period  T  of  the  radar.  The 
charge  generated  on  the  CCD  during  the  nth  radar  pulse  is  given  by 


Q(x.y.n) 


1  +  nT  2 


/ 

t-nT  2 


Kx.y.t)  dt 


In  the  above  equation  Ay  is  the  pixel  separation  in  the  CCD.  u0  =  (v2 
—  V|)/v0,  and  d  is  a  constant  phase  term.  Q(x,y)  is  the  final  output 
of  the  processor,  and  its  form  demonstrates  the  imaging  capability  of 
the  system.  In  the  x  direction.  Q(x,y)  is  a  sine  function  with  width 
trv0/ brand  centered  at  x  =  2R0v0/c.  In  other  words,  we  obtain  the 
image  of  the  point  scatterer  located  at  f  =  on  the  ground,  focused 
in  the  f  direction.  The  resolution  in  the  f  direction  is  equal  to  5,  = 
irc/2br.  This  is  a  well-known  result  for  range  resolution  in  radar 
systems.5  The  carrier  at  spatial  frequency  2up  arises  from  the  inclu¬ 
sion  of  the  reference  signal  in  the  acousto-optic  device  which  allowed 
us  to  record  on  the  CCD  the  phase  of  the  detected  signals  This  is 
necessary  in  this  system  because  the  Doppler  information  that  is 
essential  for  the  focusing  in  the  azimuth  (tj)  direction  is  encoded  in 
the  phase  of  the  range  compressed  signal  Q(x,y,n).  In  addition, 
since  the  output  forms  on  a  carrier,  it  can  be  easily  separated  from 
the  bias  term  in  Eq.  (15). 

In  the  y  direction,  Q(  x .  y)  is  also  a  sine  function  whose  position  is 
proportional  to  n0.  the  location  of  the  point  scatterer  on  the  ground 
in  the  azimuth  direction.  The  width  of  this  sine  function  is  equal  to 
cAyRo/Nvjjt^T2,  and  it  determines  the  resolution  in  azimuth.  In 
ground  coordinates  17.  the  width  of  the  sine  function  corresponds  to 
an  azimuth  resolution 


cRp 

2Nv0vT 


X0R0/2DS 


Ds  =  NvT  is  the  distance  that  the  vehicle  collecting  the  SAR  data 
travels  during  the  time  interval  NT.  and  it  is  equal  to  the  synthetic 
aperture  of  the  system.  Therefore,  the  azimuth  resolution  obtained 
with  this  processor  conforms  with  previously  derived  results5  for 
SAR  systems.  The  entire  pattern  in  shifted  in  the  y  dimension  by  the 
distance  N  Ay.  For  a  CCD  with  N  pixels  in  the  horizontal  direction, 
this  implies  that  after  the  signal  is  integrated  on  the  CCD  for  N 
pulses  to  produces  focused  image,  it  arrives  at  the  e'dge  of  the  device 
(at  y  =  NAy)  where  a  separate  CCD  stage  transfers  an  entire  line  of 
the  data  (a  slice  of  the  image  for  each  azimuth  position)  to  the  output 
pin  of  the  CCD  device  The  azimuth  slices  are  continuously  pro¬ 
duced  as  long  as  the  flight  continues,  producing  in  real  time  an  image 
of  a  long  strip  on  the  ground  parallel  to  the  direction  of  the  flight 


—  2Bvorr0T(x,y)  A(nT)sinc 
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4.  DISCUSSION 

In  this  section  we  discuss  some  of  the  issues  relative  to  the  perfor¬ 
mance  of  the  optical  processor  we  have  described  We  will  address 
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several  performance  criteria  separately  and  comment  on  the  effects 
of  the  processor  architecture  and  the  devices  used  in  the  system.  A 
complete  in-depth  analysis  of  the  performance  is  beyond  the  scope  of 
this  paper. 

4.1.  Azimuth  resolution 

In  the  previous  section  we  derived  the  formula  for  the  resolution  that 
can  be  obtained  in  the  along  track  (azimuth)  direction: 


.  =  INv^vT  »» 

N  is  the  only  parameter  in  the  above  equation  that  is  related  to  the 
processor.  N  is  the  number  of  radar  pulses  that  are  used  to  form  the 
SAR  image  of  each  point  scatterer  on  the  ground.  In  the  AO/ CCD 
processor.  N  is  also  equal  to  the  number  of  pixels  of  the  CCD  in  the 
shifting  direction  (y).  Commercially  available  CCD  cameras  have 
approximately  500  pixels.  Several  devices  with  approximately  twice 
this  number  have  recently  been  developed8  or  are  currently  under 
development.  If  a  CCD  with  I03  pixels  is  used,  the  azimuth  resolu¬ 
tion  obtainable  with  this  processor  is  22.5  meters  on  the  ground.  This 
figure  was  obtained  by  using  the  parameters  of  the  SEAS  AT  radar4 
that  was  flown  by  N  ASA.  The  azimuth  resolution  will,  of  course,  be 
different  for  different  radars.  To  obtain  lower  resolution,  larger 
CCD's  would  have  to  be  used.  It  is  unlikely  that  a  significant  increase 
in  the  size  of  monolithic  CCD  cameras  will  take  place  in  the  near 
future.  It  is  possible,  however,  to  construct  larger  arrays  by  inter¬ 
facing  a  number  of  separate  chips.  As  N  is  increased  and  finer 
resolution  is  achieved,  other  factors  in  the  processor  become  limit¬ 
ing.  such  as  optical  aberrations,  mechanical  /  electronic  stability,  and 
light  source  coherence  over  the  time  period  NT.  Finally,  for  low 
resolution  imaging,  some  of  the  approximations  that  were  made  in 
Sec.  2  may  not  be  valid.  For  instance,  if  the  approximation  that  the 
range  of  each  point  target  remains  constant  as  the  plane  flies  past  it  is 
not  valid,  an  effect  known  as  range  curvature8  results.  Range  curva¬ 
ture  can  be  corrected  in  our  processor  simply  by  tilting  one  of  the 
cylindrical  lenses  in  the  system  which  introduces  barrel  distortion 
that  can  exactly  cancel  out  the  range  curvature. 

IJ.  Image  size  in  azimuth 

The  AO/ CCD  processor  continuously  produces  slices  of  the  SAR 
images  in  the  azimuth  direction,  and  therefore  the  size  of  the  SAR 
image  is  not  limited  by  the  processor  in  this  direction. 

43.  Range  resolution 

The  resolution  in  the  range  direction  (f)  on  the  ground  is  given  by 


(17) 


The  bandwidth  of  the  chirped  radar  pulses  is  equal  to  br/  rr,  and 
[•  therefore  the  resolution  in  range  is  limited  by  the  temporal  band¬ 
width  of  the  processor.  The  bandwidth  of  the  AOD  used  in  the 

*  system  is  not  the  primarily  limiting  factor  since  devices  with  several 
gigahertz  bandwidth  are  available.  More  importantly,  the  duration 

n  of  the  light  pulse  rQ  must  be  sh oner  than  the  inverse  of  the  band- 

[•  width  of  the  signal  to  avoid  smearing  of  the  range  compressed  signal 

ft  [Eq.(  14)].  For  typical  radar  bandwidths.  r0  should  be  several  nano- 
£  seconds.  Several  laser  sources  are  capable  of  producing  nanosecond 
pulses  with  adequate  peak  power.  We  are  primarily  considering  laser 
f,  diodes  because  they  are  compact  and  power  efficient.  Laser  diodes 

(  can  lase  in  a  single  mode  under  cw  operation  (and  therefore  be 

i  '  coherent),  but  when  they  are  pulsed,  several  modes  exhibit  gain 
’  during  the  transients.  The  need  for  coherence  in  the  system  imposes 

.  with  present  state-of-the-art  devices  a  minimum  pulse  width  of  ~20 

•  ns.  Therefore,  if  a  laser  diode  is  used  in  the  system,  the  bandwidth  of 

£  the  radar  must  be  equal  to  50  MHz.  which  corresponds  to  range 

>.  resolution  equal  to  3  m.  This  can  be  lowered  by  an  order  of  magni¬ 


tude  if  a  pulsed  gas  laser  is  used.  The  additional  factors  mentioned  in 
our  discussion  on  azimuth  resolution  also  become  increasingly 
important  for  finer  range  resolution. 

4.4.  Image  size  in  range 

The  number  of  pixels  in  the  range  direction  is  limited  by  the  space- 
bandwidth  product  of  the  AOD  or  the  CCD  in  the  nonshifting 
direction,  whichever  is  smaller.  At  the  present  time,  the  CCD 
imposes  this  limit  at  approximately  I03  pixels.  The  range  coverage 
can  be  extended  by  using  several  processors  operating  in  parallel. 

43.  Flexibility 

A  potential  application  for  the  AO/ CCD  processor  is  on-board 
real-time  image  formation.  In  such  applications  the  radar  geometry 
can  be  expected  to  change  from  time  to  time  or  even  continuously. 
Enough  flexibility  must  be  built  into  the  system  so  that  it  can  be 
adaptable  to  the  changing  conditions.  One  method  for  achieving  this 
is  by  the  use  of  a  real-time  2-D  spatial  light  modulator4  in  place  of  the 
fixed  mask  in  Fig.  2.  The  impulse  response  of  the  processor  can  then 
be  altered  to  track  changes  in  the  radar  geometry. 

4.6.  Dynamic  range 

The  dynamic  range  is  defined  as  the  maximum  unsaturated  bright¬ 
ness  in  the  SAR  image  divided  by  the  minimum  detectable  level 
above  the  noise.  In  general,  a  large  dynamic  range  can  be  observed  in 
a  SAR  image  because  the  noise  detected  at  radio  frequencies  is  very 
effectively  suppressed  through  the  pulse  compression  in  both  range 
and  azimuth  that  is  performed  to  bring  the  SAR  image  into  focus. 
The  potential  for  high  dynamic  range,  however,  can  only  be  realized 
if  the  processor  that  forms  the  SAR  image  can  provide  it.  In  an 
optical  processor,  essentially  every  component  of  the  system  con¬ 
tributes  to  diminish  the  dynamic  range  available  at  the  output  by 
adding  noise  or  by  introducing  nonlinearities  and  aberrations  in  the 
system.  In  the  AO/ CCD  processor,  the  CCD  detector  is  the  domi¬ 
nant  factor  that  limits  the  dynamic  range.  The  maximum  brightness 
of  the  SAR  image  is  equal  to  the  maximum  charge  that  can  be  stored 
in  each  pixel  of  the  CCD.  minus  the  charge  that  corresponds  to  the 
bias  terms  in  Eq.  (15)  and  the  dark  current  that  accumulates  during 
the  integration  lime.  The  bias  is  signal  dependent  and  is  largest  at 
portions  of  the  SAR  image  that  have  maximum  average  intensity. 
Therefore,  relatively  sparse  objects  can  be  imaged  with  a  larger 
dynamic  range.  For  a  single  point  scatterer  on  the  ground,  the  bias 
can  be  only  1/2  of  the  full  dynamic  range  of  the  CCD.  but  for  a 
distributed  target  the  bias  increases  as  Vm.  where  M  is  the  average 
number  of  point  scatterers  on  the  ground  that  are  located  at  the  same 
range  in  a  distance  NvT  along  the  azimuth  direction.  The  minimum 
detectable  level  at  the  output  of  the  processor  is  determined  by  the 
fixed  pattern  noise  of  the  CCD  (the  variation  of  the  dark  current 
from  pixel  to  pixel),  optical  scattering,  quantum  noise  primarily  due 
to  the  bias,  and  thermal  and  amplifier  noise  from  the  electronics.10 
Our  calculations"  show  that  the  dynamic  range  of  the  images  that 
will  be  produced  by  the  experimental  processor  we  are  presently 
constructing  is  — 200: 1 .  A  commercially  available  CCD  camera  is 
used  in  the  experimental  processor,  and  post-detection  signal  pro¬ 
cessing  is  applied  in  order  to  minimize  noise.  The  dynamic  range  can 
be  increased  to  over  I03: 1  by  cooling  the  CCD  to  eliminate  the  dark 
current  and  by  using  a  CCD  specifically  designed  for  this  application. 

5.  EXPERIMENT 

The  CCD  camera  is  utilized  in  this  system  not  only  as  the  optica) 
detector  but  also  as  a  multichannel  correlator  by  operating  it  in  the 
shift-and-add  mode  described  earlier.  The  signal  that  comes  out  at 
each  column  (at  position  x|  of  the  device  is  the  correlation  between 
the  transmittance  of  the  mask  as  a  function  of  y  at  the  same  position 
x  and  the  signal  corresponding  to  the  temporal  variation  of  the 
incident  light  intensity.  We  have  performed  an  experiment  to  dem¬ 
onstrate  the  operation  oftheCCDasan  optical  multichannel  corre¬ 
lator.  The  experimental  setup  is  shown  in  Fig.  3  A  light  emitting 
diode  (LED)  is  used  as  the  light  source.  The  intensity  of  the  LED  is 
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Fig.  3.  Experimental  electro-optic  ambiguity  function  procettor. 
(LED— light  emitting  diode.  Li  —collimating  lent.  M— meek.  L2— imaging 
lent.  CCD— camera.) 


illuminates  the  mask  denoted  by  M  in  Fig.  3.  A  photograph  of  this 
mask  is  shown  in  Fig.  4<b).  The  intensity  transmittance  in  the  vertical 
direction  is  a  chirp  signal  whose  chirp  rate  is  proportional  to  the 
horizontal  position.  The  signal  at  the  center  of  the  mask  matches  the 
waveform  that  is  used  to  modulate  the  LED.  The  mask  is  imaged  by 
lens  Lj  onto  the  CCD,  which  is  operated  in  the  shift-and-add  mode. 
The  output  signal  from  the  CCD  at  each  horizontal  position  is  the 
correlation  of  the  waveform  modulating  the  LED  and  the  transmit¬ 
tance  of  the  mask  at  that  horizontal  position.  The  output  waveforms 
from  the  CCD  from  selected  vertical  locations  are  show  n  in  Fig.  4(c) 
This  2-D  waveform  is  known  as  the  ambiguity  function13  of  the  chirp 
signal,  and  Fig.  4(c)  displays  the  familiar  tilted-ridge  structure  of  the 
ambiguity  function  for  this  particular  waveform. 
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7.  APPENDIX  A:  DERIVATION  OF  EQUATION  (14) 


(,n)  =  J  l(x.y.t)  dt 


Substituting  Eq.  ( 13)  in  Eq.  ( 14): 


(x.y.n)  =  T(x.y)  J  J 5 


S,(t.x)  h(x.x)  dx  '  dt  .  (Al) 


We  will  first  evaluate  the  integral  over  x  in  the  above  expression 
Using  Eqs.  ( 10)  and  (II): 


t,x)  =^S|(t.x)  h(x,x)  dx 

=  )  P(t)r'  (t  +  — ^exp[|b,(x-x):] 

/  2,rvix\J 

X  exp  — - - jdx  . 


Substituting  the  expressions  for  P(t)  and  r'(t)  from  Eqs.  (7)  and  (9) 


Fig.  4  Ambiguity  processor  signals:  (a)  input  (LED)  waveform,  (b)  mask; 
(e)  ambiguity  function. 

temporally  modulated  by  the  chirp  signal  shown  in  Fig.  4(a).  The 
chirp  signal  that  modulates  the  LED  represents  the  variation  of  the 
intensity  detected  by  the  CCD  [the  function  Q(x  ,  y,  n)  in  Eq.  ( 14)]  as 
a  function  of  pulse  number  n.  The  duration  of  this  waveform  is  equal 
to  NT,  and  its  bandwidth  is  equal  to  v^NT ;  cR0.5  The  bandwidth 
of  the  waveform  in  Fig  4(a)  is  30  Hz,  and  its  duration  is  I  s  The 
CCD  we  used  in  this  experiment  has  N  =  512  pixels  in  the  vertical 
dimension,  and  therefore  the  duration  of  one  second  corresponds  to 
a  radar  pulse  repetition  frequency  equal  to  I  T  =0.5  kHz.  These 
parameters  were  chosen  to  be  approximately  equal  to  the  parame¬ 
ters  of  an  experimental  aircraft  radar  which  is  flown  periodically  by 
the  Jet  Propulsion  Laboratory.  We  intend  to  use  data  collected  by 
this  radar  to  test  the  processor  when  it  is  completed. 

The  light  from  the  LED  is  collimated  by  lens  L,  in  Fig.  3.  and  it 
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+  Bexp  j27rv2 

X  exp[jb,(x-x):]  exp  ^  ■  *  J  dx  .  (A3) 

and  the  expression  for  the  received  signal  r(t)  from  Eq  (6)  is 
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- - -  exp  [jb(t-2R0,c-nT  +  x/va)2] 


(A4) 


The  laser  pulse  width  r0  is  chosen  sufficiently  smaller  than  the  bandwidth  of  the  radar  pulses  ( r0  <  b r/  jr)  so  that  the  temporal  variation  of  the 
signal  in  the  above  equation  can  be  neglected  over  the  duration  of  each  light  pulse.  With  this  approximation  Eq.(A4)  can  be  rewritten  as  follows: 


g(t,x)  =  £  rect 
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exp  [j  b  |  ( x  —  x)2  ]  dx  . 
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We  can  assume  that  |  X  |  >v  r+2R0va/c,  i.e.,  the  range  delay  is  such  that  the  reflected  radar  pulse  is  entirely  in  the  aperture  of  the  AOD  at  the 
instant  the  laser  is  pulsed.  This  can  be  ensured  by  appropriately  setting  the  relative  phase  of  the  radar  and  laser  pulse  repetition  frequencies.  The 
parameter  b,  (the  focusing  power  of  the  optical  system  in  the  x  direction)  is  set  equal  tob/ vQ2.  Finally,  the  offset  frequency  v2  —  v,  is  made  to  be 
equal  to  m/T,  where  m  is  an  integer.  This  can  be  accomplished  by  deriving  v,  —  v2  from  the  pulse  repetition  frequency  I ,  T.  The  function  g(x.t) 
can  then  be  written  as  follows: 


g(x,t)  =  £  rect 
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We  substitute  the  above  expression  in  Eq.  ( 14) 
t  +  nT  2 


Kx.y.nT)  =  T(x,y)  J  £  rect  W|  A(nT)|2  vQ2  rsinc2  l^(x  — 

t— nT  2  n  °  v  “ 


2R  oVc) 


+  |B|2  +  2BA(nT)v0 


X  sine 


^-U-2R0vc)jcos 
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(14) 
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In  the  above  equation,  the  phase  terms  from  Eq.  (A6)  that  do  not 
depend  on  the  index  n  have  been  lumped  in  the  parameter  <t>. 

8.  APPENDIX  B:  DERIVATION  OF  EQUATION  (15) 

N 

Q(x,y)  =  £  Q(*.y-nAy  +  NAy,nT)  ,  (15) 


Substitute  Eq.  ( 14)  in  the  above  equation  and  the  expression  for  the 
transmittance  of  the  mask  from  Eq.  (12): 

N  (II 

Q<X.y)  =  2  2Bv0rr0  j-  +  - 

n 

X  cos  [2rru0x  — rrb2(y— (n  — N)Ay)2x]j 
X  A(nT)  sine  (x-  2R0v<][/c)j 

X  cos[2jr(v2-v,)x  vo  +  2»rv0(vnT-»j0)2/cR0  +  d>]  (Bl) 

The  spatial  frequency  u0  on  the  mask  must  be  selected  so  that  the 
sum  frequency  u0  +(v2  —  vt)/ vn  of  the  two  cosine  functions  in  the 
above  equation  is  sufficiently  large  so  that  the  signal  term  that  is 
riding  on  the  sum  frequency  can  be  separated  from  the  bias  terms  in 
the  spatial  frequency  domain.  To  accomplish  this,  we  set  u0  = 
(v2  —  v,)/va.  We  write  the  product  of  the  cosines  as  a  sum,  and  the 
term  of  interest  in  Eq.  (Bl)  takes  the  following  form: 

Q(x,y)  =  (Bvorr0/2)sinc  [(br/ jrv0)  (x-2RQva/c)] 

N 

X  XT  A(nT)  cos  [47ru0x  — rrt^y2  x 
n 

+  2  rrb2  ( n  —  N )  Ay  y  /  x  -  rrb2  Ay2  ( n  -  N  J2  /  x  +  2  rrvQ  v*T2  n2  /  cRQ 

-  4n-v0unT»j0cR0  +  2rrv0Tj02/cR0  +  d.]  .  (B2) 

The  focusing  of  the  SAR  image  in  the  azimuth  direction  (j?)  is 
accomplished  by  the  summation  over  n  in  the  above  equation.  The 
summation  will  result  in  a  well-focused  image  in  the  y  direction  if  the 
terms  containing  n2  in  the  argument  of  the  cosine  are  canceled.  To 
accomplish  this,  the  constant  b2  of  the  mask  is  set  appropriately. 


(2\0v2T2  cR0)n2  =  (^Ay^/xjn2  — 
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2v0v2T2x 
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2vov2t2 
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4vo^T2va 
t^A  y2 


(B.1) 


Equation  (B3)  and  the  value  we  previously  chose  for  u0  provide  all 
the  information  necessary  to  construct  the  mask  that  is  used  in  the 
system.  Equation  (B3)  is  substituted  in  Eq.  (B2),  and  all  inconse¬ 
quential  phase  terms  are  included  in  the  parameter  <t>.  Equation  (B2) 
then  reduces  to  the  following  equation: 

Q(x.y)  =  (BuarT0/2)  sine  [br/jrva(x-2R0va/c)] 

N 

X  £  A(nT)  cos  [4tru0x +(4»rv0v2T2/cAyR0) 
n 

x  /vT)  +  NAy)n  +  d>]  .  (B4) 

The  summation  over  n  in  Eq.  (B4)  is  recognized  as  the  discrete  cosine 
transform15  of  the  antenna  pattern  A(nT).  In  order  to  get  an  approx¬ 
imate  result,  we  can  assume  that  the  antenna  pattern  is  so  broad  in 
the  azimuth  direction  that  its  main  lobe  uniformly  illuminates  a 
distance  vNT  on  the  ground.  Therefore,  A(nT)  is  approximately  a 
constant  for  0>n>N,  and  Eq.  (B4)  can  be  evaluated  as  follows15: 


Q(x,y)  =  (BvQrrD/2)  sine  [(br/7rv0)  (x-2R0va/c)] 

sin  [(2Ntrv0v2T2/cAyR0)  (y-(r,0Ay,  vT)  +  NAy)] 
sin  [(2jrvov2T2/cAyR0)  (y  —  ( rj0 Ay / vT)  +  NAy)] 

X  cos  (4jru0x  +  <t>)  .  (B5) 

The  ratio  of  the  sines  in  Eq.  (B5)  can  be  approximated  by  a  sine 
function  for  large  N.  and  this  leads  us  to  the  final  form  of  Eq.  (15): 

Q(x.y)  =  (NBv0rr0/2)  sine  [(br/ irvQ)  (x-2R0va  c)] 

X  sine  [pNVpV^T^cAyR,,)  (y — (rj0 Ay/  vT)  +  N Ay)] 

X  cos  (4n-u0x  +  d>)  .  (15) 
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The  theory  of  operation  of  the  Real-Time  Aeouato-Optic  EAR  Proceaaor  ia  reviewed  and 
recent  experimental  reaulta  are  preaented.  The  reaults  Include  a  demonatration  of  the 
real-time  Imaging  capability  of  the  proceaaor  with  aimulated  radar  aignalx.  An  advanced 
veraion  of  thia  proceaaor  ia  then  deacribed  in  which  a  programmable  reference  function  ia 
entered  via  a  aecond  acousto-optic  device  to  eliminate  the  need  for  a  2-D  ELM.  in  thia 
implementation  the  reference  function  lx  updated  by  electronic  meane  to  give  the  proceaaor 
the  flexibility  to  adapt  rapidly  to  ebangea  in  the  parametere  of  the  radar/target  geometry. 

Introduction 

An  acouato-optic  proceaaor  which  employa  tine  and  apace  Integrating  techniquea  to  form 
Synthetic  Aperture  Radar  (SAR)  images  in  real  time  has  been  described  previously1'2,  in 
this  architecture  the  unfocuaaed  radar  algnals  are  entered  into  the  optical  system  via  an 
acouato-optic  device  (AOD)  and  the  focussed  image  is  formed  on  a  2-D  CCD.  The  range  and 
azimuth  focussing  are  performed  with  spatial  and  temporal  Integrations,  respectively.  Thia 
processor  has  been  evaluated  with  input  signals  that  simulate  the  radar  returns  that  are 
received  from  individual  point  scattezers  in  the  target  field.  Since  the  system  is 
linear,  the  processing  of  signals  from  a  point  acatterer  constitutes  a  measurement  of  the 
impulse  response,  which  completely  characterizes  the  focussing  ability  of  the  processor. 
The  results  of  this  evaluation  are  presented  in  the  next  section  following  a  brief  review 
of  the  theory  of  operation  of  the  processor. 

In  some  applications  of  SAR  the  real-time  processor  must  adapt  rapidly  to  changes  that 
occur  in  the  radar/target  geometry  in  order  to  continue  producing  a  well  focussed  image. 
One  way  to  accomplish  this  in  the  AO/CCD  architecture  is  through  the  use  of  a  real  time  2-D 
SLK  in  place  of  the  fixed  mast  on  which  the  reference  chirp  signals  are  recorded.  in  this 
paper  we  describe  an  alternate  and  preferable  approach  in  which  an  interferometric  scheme 
is  employed  to  produce  a  programmable  reference  function  and  to  eliminate  the  need  for  a  2- 
D  ELM.  In  this  advanced  version  of  the  processor  we  exploit  the  fact  that  the  desired  2-D 
reference  function  is  a  1-D  linear  FM  signal  whose  scale  varies  in  the  second  dimension  to 
account  for  the  range/azimuth  coupling  of  the  SAR  geometry;  thus  a  1-D  SLM  can  be  used  to 
enter  the  reference  function  into  the  processor  while  the  scaling  is  accomplished  by  an 
appropriate  lens  configuration.  In  this  paper  the  programmable  architecture  is  described 
and  the  results  of  the  experimental  demonstration  of  the  interferometric  generation  of 
reference  functions  are  presented. 

Xijtt  And  Space  Integrating  £AB  Architecture 

A  typical  side-looking  radar/target  geometry  is  depicted  in  Figure  1.  The  radar  is 
carried  on  an  aircraft  or  satellite  flying  at  a  constant  velocity  parallel  to  the  ground. 
The  radar  illuminates  an  area  of  the  ground  to  the  side  of  the  flight  path  so  that  a  swath 
is  swept  out  S6  shown  in  Figure  1.  The  illuminating  radiation  is  temporally  modulated  by 
periodic  LFM  pulses  so  that,  as  the  beam  passes  over  a  point  scatterer,  a  sequence  of  LFK 
radar  returns  will  be  received  from  it.  The  changing  radar/target  aspect  angle  leads  to  a 
slow  phase  modulation  over  a  sequence  of  pulses  received  from  a  point  scatterer  that  is 
superimposed  on  the  high-speed  quadratic  phaae  modulation  within  each  pulse.  This  slower 
phase  modulation  is  approximately  quadratic  with  time  and  has  a  chirp  rate  that  is 
inversely  proportional  to  the  range  of  the  point  scatterer.  The  chirp  rate  is  sufficiently 
low  that  the  phase  change  within  a  single  pulse  can  be  considered  negligible. 
Consequently,  for  a  single  point  scatterer  located  at  (xa,yf),  the  1-D  sequence  of  radar 
returns  can  be  expressed  in  a  2-D  format1  as: 

r 

r(x.jr)  -  Mexpl Jlk,(x-x,)»/jr,  ♦  k,(j-y,)»)n  (1) 

where  A,  kJt  and  kj  are  constants  and  the  variables  x  and  y  correspond  to  the  range  and 
azimuth  coordinates  on  the  ground.  To  produce  a  focussed  image  g(x,y)  of  the  point 
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Figure  1.  Typical  SAJI  Geometry 

acatterer,  the  signal  r(x,y)  must  be  correlated  with  a  kernel  h(x,y),  equal  to  r(x,y),  but 
shifted  to  the  origin.  Thus  we  have: 

*(x.y)  “  //  r(u.v)  h«(u*x.j*v)  dude  (2) 

wherei 

b(x.y)  -  expIJIk.xVy,  ♦  k,y»l)  (3) 

The  focussing  of  SAR  inages  is,  ss  evidenced  by  Equation  (2),  a  two  dinensional 
processing  problem.  Optical  signal  Processing  techniques,  being  inherently  2-D,  were 
therefore  recognized,  at  the  introduction  of  SAR,  to  be  applicable,  in  the  non-real  tine, 
film-based  optical  processing  approach  the  radar  return  signal  r(x,y)  is  recorded  on  film 
and  the  image  is  generated  by  running  the  developed  film  through  a  2-D  correlator  which 
then  performs  a  spatial  integration  in  both  the  range  and  azimuth  dimensions 
simultaneously. 

Equation  (2)  can  be  rewritten  in  the  following  manner: 

*<x.yl  -  /  (/ r  (u.v)  espIJU,  <»♦*)•>  dv]  exp(J(k,Cu*x>»/y.>  du  (4) 

Equation  (4)  reveals  that,  the  two  integrations  do  not  necessarily  have  to  be 
performed  simultaneously,  but  instead  can  be  performed  as  a  cascade  of  2  one  dimensional 
integrations.  This  feature  permits  the  AO/CCD  processor  to  use  a  1-D  SLK  as  sn  input 
device  and  process  the  reflection  of  each  radar  pulse  one  at  a  time.  Real  time  operation 
is  achieved  by  performing  a  spatial  integration  in  the  range  dimension  on  each  of  the 
radar  returns  as  they  are  received,  and  a  temporal  integration  in  the  azimuth  dimension  as 
the  range  focussed  radar  returns  accumulate  on  the  detector  at  the  output  of  the 
processor. 

The  range  processing  technique  is  depicted  in  Figure  2.  The  radar  returns  are  mixed  to 
the  center  frequency  of  an  acousto-optic  device  (AOD)  snd  applied  to  its  input.  The  AOD  is 
illuminated  with  a  beam  from  a  laser  diode  that  is  collimated  in  the  x  direction.  The 
laser  diode  is  pulsed  in  synchronism  with  the  radar  FRF,  and  has  a  pulaewidth  which  is  less 
than  the  inverse  of  twice  the  bandwidth  of  the  radar  chirp  to  essentially  freeze  the  moving 
diffraction  grating  in  the  AOD.  The  diffraction  grating  induced  by  each  point  acatterer  is 
a  one  dimensional  Fresnel  tone  plate  which  focuses  the  light  onto  a  CO  detector  to  effect 
the  pulse  compression  in  the  range  dimension. 

The  azimuth  pulse  compression  is  performed  by  correlation  of  the  quadratic  phase  history 
of  the  radar  returns  from  each  point  scatterer  with  a  mask  on  which  the  matching  phase 
history  is  recorded  for  each  range  bin.  This  technique  is  depicted  in  Figure  3.  The 
phase  of  the  radar  signals  is  detected  by  interfering  the  range  focussed  light  with  a 
plane  wave  generated  by  applying  a  sinusoidal  reference  signal  to  the  AOD  in  addition  to 
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the  radar  algnal.  The  light  fro*  the  AOD  ia  eolllaatad  in  the  y  direction  to  uniforaly 
lllwinate  the  *aak  which  ia  placed  directly  in  front  of  the  2-D  CCS  detector.  The  CCD  is 
operated  in  the  shift-and-add  mode,  in  the  y  direction,  at  a  shift  rate  equal  to  the  PRF  of 
the  radar,  thus  giving  the  effect  of  a  aoving  detector  behind  the  stationary  aaak.  As  the 
photogenerated  charge  on  the  detector  *oves  coapletely  across  the  cask,  the  charge  that 
builds  up  on  the  detector  corresponds  to  the  co*pleted  azimuth  correlation.  The  image, 
which  has  now  been  focussed  in  both  range  and  aziauth,  is  raad  out  by  the  CCS  at  a  line 
rate  equal  to  the  PRF  of  the  radar.  The  complete  AO/CCS  Real-tiae  SAJt  Processor  is  shown 
schematically  in  Figure  4  and  an  sxaaple  of  a  raferance  cask  ia  given  in  Figure  5. 


Slum. 

Figure  2.  Acousto-optic  processor  that  performs 
the  focussing  of  the  SAP  image  in  range. 
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Figure  3.  Time  integrating  optical  processor  that 
performs  the  focussing  of  the  SAP  image  in  azimuth. 
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Figure  4.  Peal-time  Acousto-optic/CCD  SAP  Processor 
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Figure  5.  Azimuth  reference  seek 


The  reel-time  imaging  ability  of  the  AO/CCD  eyatem  has  been  demonstrated  by  measuring 
the  impulse  response  of  the  processor.  A  block  diagram  of  the  electronics  used  in  these 
measurements  is  shown  in  Figure  6  interfaced  to  the  optical  procesaor.  The  SAR  Impulse 
Response  Generator  simulates  the  radar  signal  that  would  be  received  from  a  single  point 
scatterer  in  the  target  field.  A  SAW  device  is  used  to  produce  a  sequence  of  LFM  pulses 
at  a  fixed  FRF.  The  quadratic  phase  history  of  a  sequence  of  radar  returns  from  a  single 
point  scatterer  in  a  particular  geometry  is  calculated  and  stored  in  digital  memory.  The 
pulses  from  the  SAW  device  pass  through  a  digitally  controlled  phase  shifter  which  imparts 
the  stored  phase  history  to  the  sequence.  The  simulated  radar  returns  are  then  summed  to 
the  reference  signal  and  applied  to  the  AOD  of  the  processor.  The  electronic  signals  that 
trigger  the  LD  and  CCD,  and  produce  the  reference  beam  for  the  azimuth  correlation  are  all 
generated  in  synchronism  with  the  Impulse  Response  Generator.  The  isometric  display  block 
grabs  a  frame  of  the  scrolling  CCD  output  and  displays  the  focussed  image  of  the  point 
scatterer  in  either  a  2-D  or  3-0  perspective  format  for  analysis. 

The  output  of  the  Impulse  Response  Generator  forms  a  tone  plate  when  displayed  in  2-D 
format,  corresponding  to  the  unfocussed  image  of  the  point  scatterer.  An  example  of  such 
an  output  is  shown  in  Figure  7  where  the  horizontal  and  vertical  coordinates  correspond  to 
the  range  and  azimuth  dimensions,  respectively.  The  signal  corresponds  to  the  asymmetrical 
Fresnel  zone  plate  given  by  Equation  1.  Figure  6  ahows  the  real  time  output  of  the 
processor  when  a  series  of  unfocussed  Images  simlllar  to  that  of  Figure  7  are  entered 
sequentially.  The  focusaed  spots  correspond  to  a  pulse  compression  ratio  of  about  40  in 
both  the  range  and  azimuth  dimensions.  The  maximum  pulse  compressions  that  have  been 
achieved  with  the  experimental  SAR  Processor  are  100  and  160  for  the  range  and  azimuth 
dimensions,  respectively.  These  numbers  are  within  a  factor  of  2  of  the  predicted  values. 
The  dynamic  range  for  a  single  simulated  point  scatterer  was  measured  to  be  in  excess  of 
100:1. 
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Figure  6.  Impulse  Response  Experiment 
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Figure  B.  AO/CCD  Processor  output!  Reel-tine 
imaging  of  simulated  radar  point  acetterers. 
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Interferometrlcally  Generated  Azimuth  Reference  Function 


In  Borne  applications  the  parameters  of  the  radar/target  geometry,  such  as  the  velocity 
and  altitude  of  the  aircraft,  and  direction  in  which  the  antenna  is  pointed,  change 
dynamically.  The  real-time  BAR  imager  must  have  the  ability  to  adapt  rapidly  to  such 
changes  in  order  to  continuously  provide  a  veil  focussed  image.  Since  the  impulse  response 
of  the  AO/CCD  processor  in  the  azimuth  direction  is  determined  by  the  mask  on  which  the 
reference  chirps  are  recorded,  the  mask  could  be  replaced  by  a  2-D  SLR  on  which  the 
proper  reference  function  could  be  written  and  updated  aa  needed.  However,  examination  of 
the  required  2-0  reference  function  (see  Figure  5)  reveals  that,  when  the  overall  range  to 
the  target  is  large  when  compared  to  the  awatb  width,  then  the  reference  function  is 
approsimated  well  by  a  1-0  baseband  LFM  signal  in  the  azimuth  direction,  whose  scale  varies 
in  the  range  direction  to  account  for  the  range/azimuth  coupling  of  the  geometry.  This 
suggests  that  a  1-D  SLR  can  be  used  to  input  the  reference  function  to  the  processor  and 
the  range/azimuth  coupling  can  be  introduced  by  an  appropriate  anamorphic  lens 
arrangement. 

An  interferometric  scheme  in  which  the  2-0  azimuth  reference  function  is  generated  using 
a  1-0  input  SLR  is  shown  schematically  in  Figure  9.  An  electronic  chirp  signal  is  applied 
to  an  AOD  along  with  a  sinusoidal  reference  signal.  After  the  acoustic  signals  have 


Figure  9.  Optical  Set-up  for  the  Interferometric  Generation  of  the  SAR  azimuth  filter 

propagated  to  the  center  of  the  AOD,  the  laser  diode  is  pulsed  to  freeze  the  moving 
diffraction  gratings  in  the  same  manner  as  the  radar  signal  is  sampled  in  the  AOD  of  the 
SAR  processor  described  previously.  An  anamorphic  lens  arrangement  is  used  to  spread  the 
diffracted  light  uniformly  in  the  x  direction  at  the  detector  plane.  The  undiffracted 
light  (not  shown  in  Figure  9)  is  blocked  and  not  used.  In  the  y  direction  the  diffracted 
light  from  the  slnuaoidal  reference  signal  in  the  AOD  will  be  a  plane  wave  that  is 
transformed  into  a  cylindrical  wave  at  the  detector;  the  light  diffracted  by  the  chirp 
signal  will  be  a  cylindrical  wave  that  is  transformed  into  a  cylindrical  wave  of  different 
curvature  at  the  detector.  The  waves  from  the  chirp  and  reference  signals  will  have 
different  radii  of  curvature  and  therefore  the  resulting  interference  pattern  on  the 
detector  will  be  a  LFR  signal  in  the  y  direction.  The  scaling  that  is  required  in  the  x 
direction  to  account  for  the  range/azimuth  coupling  is  accomplished  by  tilting  a 
cylindrical  lens  about  the  y  axis,  as  shown  in  Figure  9. 

Figure  IB  is  a  photograph  of  an  interferometrical ly  generated  azimuth  filter  produced 
with  the  system  described  above.  The  2-0  CCD  camera  was  operated  in  standard  video  mode 
and  its  output  displayed  on  a  monitor  for  data  acquisition.  During  the  integration  period 
of  each  video  frame  the  AOD  was  loaded  and  illuminated  several  hundred  times  to  produce  a 
high  contrast  ratio  in  the  reference  function.  A  comparison  of  Figures  10  and  5  shows 
that,  aaide  from  differences  in  levels  of  exposure,  the  interferometrical ly  generated 
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Figure  If.  Xnterferoaetrically  generated  azimuth  reference  function. 
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function  hes  nearly  the  ease  azimuth  bandwidth  and  range/aziauth  coupling  paraaeter  aa  the 
fized  mask. 


n  || y |  ■■■lilt  architecture 

The  interferoaetrlc  technique  for  SAR  azlauth  filtering  can  be  integerated  with  the 
range  proceaaing  technique  of  Figure  2  to  faahion  a  aaakleas  programmable  real-time  SAR 
processing  architecture.  One  approach  ia  a  two  arm  interferometer  in  which  the  light  that 
is  aodulated  by  the  range  focussing  AOD  follows  a  different  path  to  the  output  CCD 
detector  than  the  light  that  forms  the  azimuth  filter.  Alternatively,  it  is  possible  to 
cascade  the  two  systems  so  that  the  Interfering  light  beams  follow  the  same  path  through 
the  optical  system,  thereby  minimizing  the  stability  requirement.  The  cascaded  system  is 
shown  in  Figure  11.  As  in  the  original  processor,  the  radar  signal  is  range  focussed  and 
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lti  phase  ia  detected  interferometr leal ly  at  tha  datactor.  Sine*  tba  light  la  now  also 
diffracted  by  tha  aacond  AOD,  containing  tha  aximuth  reference  aignal,  it  la  affactivaly 
■ul tipi lad  by  tha  interferometrlcally  ganaratad  reference  function.  Operation  of  tha  CCD  in 
tha  ahif t-and-add  soda  will  complete  tha  neceaaary  aximuth  correlation  at  in  tha  non¬ 
programmable  architecture. 

Tha  programmable  architecture  gives  tha  AO/CO  proceaaor  flexibility  to  adapt  to  changes 
in  tha  radar/targat  geometry  by  electronically  changing  the  starting  frequency  and  chirp 
rata  of  tha  aximuth  rafaranca  aignal.  Equally  aignifigant  ia  tha  fact  that  this 
architecture  allows  tha  aximuth  correlation  to  be  performed  by  shifting  tha  rafarance 
function  incrementally  in  tha  AOD  rather  than  shifting  and  adding  tha  charge  on  tha  CCD. 
This  capability  is  useful  for  performing  multiple  looks,  i.a.  forming  several  images  of  tha 
same  area  indapandantly  and  adding  them  to  reduce  speckle.  Furthermore,  shifting  the 
rafaranca  signal  in  tha  AOD  is  useful  for  Spot-light  Mode  SAR,  in  which  it  is  desired  to 
fora  tba  image  in  a  frame-by-frame  rather  than  in  a  scrolling  manner. 
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Uaiact 

Recent  advancenenta  in  the  development  of  the  Real  Time  Acousto-optic  SAR  Processor 
are  presented.  In  particular,  the  technique  for  introducing  the  azimuth  reference  function 
into  the  processor  via  an-acousto-optic  Bragg  cell  ia  discussed.  This  approach  permits  the 
reference  function  to  be  stored  in  electronic  memory,  thus  giving  the  processor  the 
flexibility  needed  to  adapt  rapidly  to  changes  in  the  radar/target  geometry.  The 
architecture  is  described  and  results  are  presented  which  show  the  applicability  of  the 
technique  to  both  spot-light  and  strip-map  SAR. 


Introduction 

The  formation  of  high-resolution  images  using  the  Synthetic  Aperture  Radar  (SAR) 
technique  is  one  of  the  most  successful  applications  of  optical  signal  processing 
technology.  Film-based  coherent  processors  account  for  a  major  portion  of  the  SAR  images 
produced  to  date.  *3  Although  film  provides  a  convenient  high-density  data  storage  medium 
and  can  also  serve  as  input  spatial  light  modulator  (SLM)  for  the  optical  processor,  the 
need  for  chemical  development  of  the  exposed  film  precludes  its  use  in  real-time 
applications.  Recently.  advances  in  the  technology  of  light  sources,  modulators,  and 
detectors  have  led  to  optical  SAR  imagers  which  do  not  require  film,  can  handle  the 
computational  load  at  real-time  rates,  and  are  relatively  compact  and  low  in  power 
consumption. 

An  acousto-optic  time-and-space  integrating  architecture  for  real-time  SAR  imaging  has 
been  described  previously3’4.  In  this  architecture  an  acousto-optic  device  (ADD)  is  used 
to  enter  the  unfocused  radar  signals  into  the  optical  system.  The  image  is  formed  on  a  2-D 
charge-coupled  device  (CCD)  detector  array.  The  range  and  azimuth  focusing  are  performed 
with  spatial  and  temporal  integrations  of  light,  respectively. 

An  advanced  version  of  this  processor  is  now  being  developed  in  which  the  azimuth 
reference  function  is  entered  into  the  processor  via  a  second  AODs.  instead  of  with  a  2-D 
intensity  mask  or  SLM  as  was  done  in  the  earlier  architectures.  With  this  technique  the 
desired  azimuth  filter  function  can  be  synthesized  electronically  and  updated  at  high 

rates. 

In  the  next  section  of  this  paper  we  briefly  review  the  signal  processing  requirements 
of  a  SAR  imager.  This  discussion  serves  to  illuminate  the  aspects  of  the  real-time  SAR 
problem  that  are  exploited  in  the  AO/CCD  processor.  The  techniques  used  to  accomplish  the 
range  and  azimuth  compressions  are  then  described.  The  theory  of  operation  of  the  complete 
architecture,  in  which  the  range  and  azimuth  processing  are  combined  interferometrically, 
is  presented.  Finally,  we  ahow  the  results  of  an  impulse  response  characterization  of  the 
processor  in  which  both  framing  and  scrolling  modes  are  demonstrated. 


Bional  Processing  Reoulr— |mf I 

In  a  SAR  geometry,  the  result  of  the  radar  illumination  and  subsequent  collection  of  the 
backscattered  radiation  is  a  mapping  of  the  2-D  reflectivity  of  the  target  scene  into  its 
unfocused  image.  The  unfocused  image  is  a  summation  of  windowed,  weighted,  asymmetrical  2- 
D  quadratic  phase  functions,  whose  positions  and  weights  are  determined  by  the'  location 
and  strength  of  the  associated  point  scatterers  of  the  target  scene.  The  degree  of 
asymmetry  in  the  unfocused  image  of  each  point  acatterer  is  determined  by  the  parameters  of 
the  radar  and  the  radar/target  geometry.  The  2-D  filtering  required  to  form  the  image  is  a 
linear  operation.  Therefore,  in  describing  the  processing,  we  need  consider  only  a  single 
point  acatterer  as  the  input.  For  a  single  point  scattere:  located  at  coordinates  (x«.y,>. 
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th«  1-0  sequence  of  radar  returns  Is  expressed  in  s  2-0  format2  as: 

r<x.y)-  Alexpl jlk»(x-x,)**  k, <y-y. ) *(l*ax, ) /R. 1 1 ] 


where  A.  a.  k»  and  kt  are  constants  determined  by  the  parameters  of  the  radar  and  the 
radar/target  geometry.  The  variables  x  and  y  correspond  to  the  range  and  azimuth 
coordinates  on  the  ground,  respectively.  The  origin  of  the  ground  coordinates  is  taken  to 
be  the  center  of  the  swath  located  at  range  R(,  with  y-o  defined  to  be  the  position 
directly  abeam  of  the  radar  at  the  start  of  data  collection.  In  Eq.  (1)  we  assume  x*  <<  R». 

In  the  conventional  non-real-time  optical  approach,  the  function  in  Eq.  (l>  is  recorded 
on  photographic  film  as  a  Fresnel  tone  plate.  The  image  is  then  formed  by  a  coherent 
optical  processor  consisting  of  an  anamorphic  lens  arrangment  to  correct  for  the 
range/azimuth  coupling  and  the  zone  plate  asymetry.  which  focuses  the  collection  of  zone 
plates  into  a  high  resolution  image.  For  each  point  scatterer.  the  required  operation  is  a 
correlation  with  a  kernel  h(x,y).  equal  to  r(x.y).  but  shifted  to  the  origin.  Thus  we 
have : 


g(x.y)  -  //  r(u.v)h*(u*x.y+v)dudv  (2) 

where: 

h(x.y)  •  exptj[kax'  *  k,y* (l+«x« > /R,] ]  (3) 


The  required  processing  steps  of  a  EAR  imager  are  shown  pictorial ly  in  Fig.  l. 
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Figure  1.  EAR  Processing 


In  the  film-based  optical  processing  approach  the  image  is  generated  by  running  the 
data  film  through  a  2-D  correlator  which  performs  a  spatial  integration  of  light  in  both 
the  range  and  azimuth  dimensions  simultaneously.  However,  the  required  integrations  in  the 
two  dimensions  do  not  necessarily  have  to  be  performed  at  the  same  time.  This  i6  shown  by 
rewritting  Eq.  (2)  in  the  following  manner: 


g(x.y)»  /  I/r (u, v)exp(- j (k t (u*x) * )du J  exp(- j (k > (l*«x« ) (v+y) */R, )  dv  (4) 


Eq.  (4)  reveals  that  the  two  integrations  can  be  performed  as  a  cascade  of  two  one 
dimensional  Integrations.  This  feature  permits  the  AO/CCD  processor  to  use  a  l-D  SLM  as 
an  input  device  and  process  the  reflection  of  each  radar  pulse  one  at  a  time.  .Real-time 
operation  is  achieved  by  performing  a  spatial  integration  in  the  range  dimension  on  each 
of  the  radar  returns  as  they  are  received,  and  a  temporal  integration  in  the  azimuth 
dimension  as  the  range  focused  radar  returns  accumulate  on  the  detector  at  the  output  of 
the  processor. 


Architecture  Description 

The  range  processing  technique  is  depicted  in  Fig.  2.  The  radar  returns  are  mixed  to 
the  center  frequency  of  an  AOD  and  applied  to  its  input.  The  AOD  is  illuminated  with  a 


beam  from  a  laser  dloda  that  ia  collimated  In  tha  a  direction.  The  laser  diode  is  pulsed 
in  synchronise  with  the  radar  PRF,  and  baa  a  pulaawidth  which  ia  leas  than  one  half  the 
Inverse  of  the  bandwidth  of  the  radar  chirp  in  order  to  freeze  the  aoving  diffraction 
grating  in  the  AOD.  The  diffraction  grating  induced  by  each  point  acatterer  is  a  one 
dimensional  Fresnel  sone  plate  which  focuses  the  light  onto  a  CCD  detector  to  effect  the 
pulse  compression  in  the  range  dimension. 

The  interferometric  technique  by  which  the  phase  of  each  radar  return  ia  detected  for 
the  asiauth  processor  is  also  depicted  in  Fig.  2.  A  sinusoidal  reference  signal,  which  is 
coherent  with  the  radar  waveform,  ia  added  to  the  radar  return  signal -and  the  sum  is 
applied  to  the  input  transducer  of  the  AOD.  The  light  diffracted  by  the  AOD  due  to  the 
reference  is  a  plane  wave  in  the  s  direction  which  interferes  with  the  range  focused  light 
at  the  detector  plane  to  record  its  amplitude  and  phase.  This  technique  has  a  significant 
advantage  over  other  interferometric  approaches  in  that  it  is  insensitive  to  mechanical 
vibrations,  since  the  interfering  beams  pass  through  the  same  optical  elements.  The 
azimuth  pulse  compression  is  performed  by  correlating  the  quadratic  phase  history  of  the 
radar  returns  from  each  point  acatterer  with  a  spatial  intensity  aoduation  which  matches 
the  phase  history  for  each  range  bin.  In  the  original  architecture  the  spatial  modulation 
was  performed  by  a  fixed  intensity  mask.  The  time  integration  taebnique  for  the  azimuth 
compression  is  depicted  in  Fig.  J.  The  phase  of  the  range  focused  radar  signals  is 
lnterf erometrical ly  detected  as  described  above,  resulting  in  a  sampled  temporal  intensity 
modulation  of  the  range  focused  light  beam,  occuring  over  the  sequence  of  radar  returns. 
The  light  from  the  AOD  is  collimated  in  the  y  direction  to  uniformly  illuminate  the  mask 
whose  transmittance  is  equal  to  the  azimuth  phase  history  and  is  placed  directly  in  front 
of,  or  imaged  onto  the  2-D  CCD  detector.  The  CCD  is  operated  in  the  shift-and-add  mode,  in 
the  y  direction,  at  a  shift  rate  equal  to  the  FRF  of  the  radar,  thus  giving  the  effect  of  a 
moving  integrating  detector  behind  the  stationary  mask.  As  the  photogenerated  charge  on 
the  detector  moves  across  the  mask,  the  charge  that  builds  up  on  the  detector  corresponds 
to  the  azimuth  correlation.  The  image,  which  has  now  been  focused  in  both  range  and 
azimuth,  is  read  out  by  the  CCD  at  a  line  rate  equal  to  the  PRF  of  the  radar.  Electronic 
post-processing  is  used  to  remove  bias  terms  that  form  due  to  the  interferometric 
detection.  The  complete  AO/CCD  Real-time  SAR  Processor  is  shown  schematically  in  Fig.  4 
and  an  example  of  a  reference  fuction,  in  the  form  of  an  intensity  mask,  is  given  in  Fig. 
5. 


Figure  2.  Acousto-optic  processor  that  Figure  ).  Time  integrating  optical 

performs  the  range  focusing  of  the  SAR  processor  that  performs  the  focusing  of 

image  and  phase  detection  for  the  the  SAR  image  in  azimuth, 

azimuth  correlator. 

In  some  applications,  the  parameters  of  the  radar/target  geometry,  such  as  the  velocity 
and  altitude  of  the  aircraft,  and  direction  in  which  the  antenna  is  pointed,  say  change 
dynamically.  The  real-time  SAR  laager  must  have  the  ability  to  adapt  rapidly  to  such 
changes  in  order  to  continuously  provide  a  well  focused  image.  To  accomplish  this  with  the 
system  of  Fig.  4.  the  mask  could  be  replaced  by  a  real-time  2-D  SLR  on  which  the  proper 
reference  function  is  written  and  updated  as  needed.  Examination  of  the  required  2-D 
reference  function  (see  Fig.  5)  reveals  that,  when  the  overall  range  to  the  target  is  lerge 
when  compared  to  the  swath  width,  the  reference  function  is  approximated  well  by  a  x-D 
baseband  LFH  signal  in  the  azimuth  direction,  whose  scale  varies  linearly  in  the  range 
direction  to  account  for  the  range/aziauth  coupling  of  the  geometry.  Therefore,  a  l-D  SLR 


can  ba  uaad  to  input  tha  rafaranca  function  to  tba  procaaaor  and  tba  range/azimuth 
coupling  can  be  introduced  by  an  appropriate  anamorphic  lana  arrangement  to  provide  tbe 
acaling  in  tba  orthogonal  direction.  Pig.  <  ia  an  example  of  an  interferometrically 
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Figure  4.  Real-time  Acousto-optic/CCD  SAR  Processor. 

generated  azimuth  filter  whose  characteristics  were  chosen  to  match  those  of  the  intensity 
mask  of  Fig.  S.  The  optical  set-up  used  to  produce  the  data  of  Pig.  <  is  shown 
schematically  in  Fig.  7.  An  electronic  chirp  signal  is  applied  to  an  AOD  along  with  a 
sinusoidal  reference  signal.  After  the  acoustic  signals  have  propagated  to  the  center  of 
the  AOD.  the  laser  diode  is  pulsed  to  freeze  the  moving  diffraction  gratings  in  the  same 
manner  as  the  radar  signal  is  sampled  in  the  AOD  of  tbe  SAR  processor  described  previously. 
An  anamorphic  lens  arrangement  is  used  to  spread  the  diffracted  light  uniformly  in  the  x 
direction  at  the  detector  plane.  The  undiffracted  light  (not  shown  in  Fig.  7)  is  blocked 
and  not  used.  In  the  y  direction  the  diffracted  light  from  the  sinusoidal  reference 
signal  in  the  AOD  is  a  plane  wave  that  is  transformed  into  a  cylindrical  wave  at  the 
detector  plane.  The  light  diffracted  by  the  chirp  signal  is  a  cylindrical  wave  that  is 
transformed  into  a  cylindrical  wave  of  different  curvature  at  the  detector  plane.  The 
waves  from  the  chirp  and  reference  signals  have  different  radii  of  curvature  and  therefore 
the  resulting  interference  pattern  on  the  detector  will  be  approximately  equal  to  a  LFM 
signal  in  the  y  direction.  The  scaling  that  is  required  in  the  x  direction  to  account  for 
the  range/azimuth  coupling  is  accomplished  by  tilting  a  cylindrical  lens  about  tbe  y  axis, 
as  shown  in  Fig.  7.  A  comparison  of  Figs.  (  and  5  shows  that,  aside  from  differences  in 
levels  of  exposure,  the  interferometrically  generated  function  has  nearly  the  same  azimuth 
bandwidth  and  range/azimuth  coupling  parameter  as  tbe  fixed  mask.  An  architecture  using 
the  interferometrically  generated  reference  filter  has  the  flexibility  to  adapt  to  changes 
in  the  radar/target  geometry  by  changing  the  characteristics  of  the  electronically 
generated  chirp.  The  parameters  that  may  be  changed  Include  the  starting  frequency,  the 
starting  time,  and  the  chirp  rate  of  the  azimuth  reference  signal. 


Figure  5.  Azimuth  reference  mask. 


Figure  *.  Interferometrically  generated 
azimuth  reference  function. 
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A  programmable  real-time  SKR  processing  architecture  is  synthesized  by  integrating  the 
interferometric  technique  for  SAX  azimuth  filtering  with  the  range  processing  technique  of 
Pig.  2.  One  posible  approach  is  an  additive  interferoaetric  architecture  in  which  the  AOD 
cotaining  the  radar  waveform  is  placed  in  one  era  of  a  Hach-Iehnder  interferometer  and  the 
AOD  containing  the  ezlauth  reference  is  placed  in  the  second  are  and  oriented  orthogonally 
to  the  first  AOD.  This  approach,  however,  is  subject  to  the  saae  sensitivity  to  aechanical 
vibration  that  plagues  all  multiple  path  interferometers. 
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Figure  7.  optical  Set-up  for  the  Interferoaetric  Generation  of  the  SAX  azimuth  filter 

An  alternate  and  preferrable  approach  is  a  multiplicative  interferometric  architecture 
in  which  the  radar  and  azimuth  filter  systems  are  cascaded.  In  this  implementation  the 
interfering  beams  all  pass  through  the  same  optics  and  thus  the  stability  problems  are 
minimized.  The  cascaded  system  is  shown  schematically  in  Pig.  s.  As  in  the  original 
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Figure  •.  Programmable  Architecture 
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processor,  the  rsdar  signal  is  range  focused  and  its  phase  is  detected  interferometrically 
at  the  detector  by  a  reference  bean  that  is  generated  by  the  sane  AOD.  However,  since  the 
diffracted  light  from  the  first  AOD  is  also  diffracted  by  the  second  AOD.  which  contains 
the  azimuth  reference  signal  plus  a  sinusoidal  signal,  it  is  aultiplied  by  the 
interferoaetrically  generated  reference  function.  This  lapleaentation  thus  achieves  the 
saae  aultiplication  needed  to  perform  the  azimuth  compression  as  in  the  original  non- 
prograaaable  architecture. 

This  architecture  offers  two  possible  sodas  of  operation.  Operation  of  the  CCD  in  the 
shift-and-add  mode,  while  repeating  the  saae  azimuth  filter  signal  for  each  radar  return, 
will  complete  the  necessary  azimuth  correlation  as  in  the  original  processor.  This  mode 
is  used  for  side-looking  SAR  in  which  the  output  image  is  a  long  strip.  Alternately,  the 
azimuth  correlation  aay  be  performed  by  electronically  shifting  the  reference  function 
incrementally  in  the  AOD  and  using  a  nonshifting  integrating  CCD  detector  array.  In  this 
mode  the  image  is  generated  in  a  framed  format  that  is  most  useful  for  spotlight  mode  SAR. 

The  operation  of  the  multiplicative  architecture  is  best  understood  by  considering  the 
two  AODs  a6  stationary  l-D  amplitude/phase  gratings.  This  is  justified  because  the  pulse- 
width  of  the  laser  diode  is  short  enough  to  sample  the  moving  diffraction  patterns  in  the 
AODs.  Consider  as  input  to  the  processor  the  radar  returns  from  a  point  scatterer  at  ground 
coordinates  (x(,y«)  with  complex  strength  A.  The  corresponding  range  and  cross-range 
(azimuth)  coordinates  in  the  Processor  are  x»  and  y,  respectively.  For  simplicity  we 
assume  the  x  and  y  coordinates  in  the  output  plane  of  the  processor  to  be  the  same  as  in 
the  corresponding  AODS,  i.e..  the  optical  aagnif ication  is  l.  The  strength  of  the 
reference  signal  in  the  range  processing  AOD  is  B.  which  is  assumed  to  be  real  without  any 
loss  of  generality.  The  radar  returns  are  mixed  down  to  the  center  frequncy  of  the  AOD. 
•  (,  which  is  also  the  frequency  of  the  reference  signal.  A  total  of  N  returns  are  recieved 
from  the  point  scatterer.  With  these  assumptions,  the  i-D  diffraction  pattern  induced 
along  the  x  axis  in  the  first  AOD.  by  the  nth  radar  return,  is  expressed  in  the  following 
way : 


P»(x,y.n)  - 

lAexp(  j  (k  i(x-x,  )  **lc ,  (l  +  ax.  )  (r.-y,  /  Ay )  */R.)rect  ( (x-x, ) /X. )  ♦  Bl  exp(jw.x)  6  ( y )  (5) 


where  Ay  is  the  spacing  of  the  azimuth  samples  in  the  processor  or.  equivalently,  the  pixel 
size  in  the  azimuth  dimension  at  the  output  detector.  The  spatial  carrier  frequency. 
is  equal  to  S,  devided  by  the  acoustic  velocity  of  the  AOD.  The  parameters  k»  and  X.  are 
determined  by  the  chirp  rate  and  the  length  of  the  transmitted  LFK  radar  pulse 
respectively. 

The  second  AOD  contains  the  azimuth  filter  signal  and  a  sinusoidal  reference  which  is 
chosen  to  be  at  the  same  frequency  as  the  reference  sinusoid  in  the  first  AOD.  The  azimuth 
reference  filter  is  a  LFK  signal  with  chirp  rate  bt.  The  azimuth  and  sinusoidal  reference 
signals  have  equal  amplitudes  to  achieve  maximum  fringe  depth  in  the  interf erometrical ly 
generated  azimuth  filter.  As  mentioned  earlier,  the  azimuth  correlation  is  computed  by 
shifting  either  the  integrating  detector  array  or  the  filter  signal  in  the  AOD. 
Mathematically  these  operations  are  essentially  equivalent.  If  we  asume  the  grating  shifts 
one  pixel  with  respect  to  the  detector  array  for  each  radar  return,  then  the  l-D 
diffraction  grating  in  the  second  AOD  is  expressed  as: 


Pt(x.y.n)  »  (  exp( j (b» (y-niy) *  ♦  l  )  exp(j»,x)  Kx) 


(«) 


The  output  CCD  array  detects  and  integrates  the  intensity  of  the  doubly  Bragg 
diffracted  light.  a6  shown  in  Fig.  I.  The  intensity  at  the  detector  is  given  by: 


Hx.y.n)  -  lE,(x.y.n)l*  lE,(x.y.n)l*  (7) 


where  E»  and  E(  are  the  amplitude  modulation  envelopes  of  the  diffracted  light  at  the 
detector  plane,  for  the  first  and  second  AODs  respectively.  The  range  focusing  operation 
of  the  optics  on  the  radar  return  aignal  in  the  x  dimension  can  be  shown  to  result  in  a 
light  amplitude  distribution  that  is  a  sine  function  whose  characteristics  are  determined 
by  the  space-bandwidth  product  (SBWP)  of  the  range  chirp.  The  light  diffracted  by  the 
ainusoldal  reference  signal  is  collimated  by  the  optics  in  the  x  dimension,  as  shown  in 
Fig.  •.  Both  beams  diffracted  by  the  first  AOD  are  smeared  uniformly  in  the  y  dimension  at 
the  output  plane.  The  light  that  is  diffracted  by  the  second  AOD  is  essentially  imaged 
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^  onto  tbe  output  plan*  in  the  y  dimension  and  smeared  in  the  x  dimension  by  the  optics.  The 

tilt  of  the  cylindrical  lens  in  rig.  •  results  in  a  scale  change  on  the  Imaged  azimuth 
\  reference  chirp  as  a  function  of  x.  As  can  be  seen  in  rig.  «,  this  scale  change  is 

•„  approximately  linear  in  x  when  considering  suitable  range  swaths  for  processing.  The 

^  resulting  modulation  envelopes  are  given  by: 


Ei(x.y.n)  -  t  AX» sine (kiX* <x-x, ) )  exp< jE» <n-y, /ay ) * (!♦•*. > /R. >  *  B  )  (8) 


E'(x.y.n)  -  [  exp( jb»( (y-nAy) (l*8x) )  >  +  l  1  (9) 

rrom  Eq.  (7)  the  resulting  intensity  at  the  detector  plane  is  therefore  given  by: 
I(x.y.n)-  [B**(AX« ) *sinc^<k »x« (x-x« ) )*JABX«sinc(k iX. (x-x«))cos(K*(n-y,/Ay) ’(l*«x, )/R») 3 


*  [  l  ♦  cos(b» ( (y-nAy) (i+>x) )  )  ] 


(10) 


The  charge  accumulated  in  each  pixel  of  the  CCD  is  proportional  to  the  intensity  incident 
on  it.  The  total  charge  accumulated  on  the  CCD  after  the  N  radar  returns  have  been 
recieved  from  the  point  acatterer  is: 


N 

aj(x.y)  -  £  l(x.y.n)  di> 

n-i 


Dsing  Eq.  (10)  and  assuming  that  Px<<l: 


Qij.(x  ,y)  -  2ABNX.sinc(k1X.(x-X')) 

N  .  » 

*  Y,  cos(K,(l*ax»)<n-y*/Ay)  /R,)coB((b,((l*2Px)(y-nAy>  ) 
n-1 

♦  bias  terms  (12) 


If  ba  and  p  are  selected  (programmed)  to  be  equal  to  E,/R«Ay  and  o/2,  respectively,  then  a 
discrete  autocorrelation  of  the  LFM  signals  in  the  azimuth  direction  results.  Keeping  only 
the  significant  terms,  the  final  result  is: 


Oj.(x.y)  -  2NABX'  sinc(kiX. (x-x. ) >  Sinc( (Ji,N/R.Ay ) ( 1+ex# ) (y-y. ) ) 

♦  HB*  ♦  N(AX. ) ‘sine* (k,X» (x-x, ) )  (13) 


Pig.  9  is  a  sketch  of  the  charge  profile 
which  is  stored  on  the  CCD  as  given  by  Eq. 
(13).  The  first  term  in  Eq.  (13)  is  a  2-D 
sine  function  whose  height  is  proportional  to 
the  reflective  strength  of  the  point 
acatterer  and  whose  center  is  located  at 
coordinates  (X'.y.)  corresponding  to  the 
actual  location  of  the  acatterer  on  the 
ground.  The  width  of  the  sine  function  in 
each  dimension  is  Inversely  proportional  to 
the  SBWP  of  the  unfocused  image  in  the 
corresponding  dimension.  Thus  thiB  term 
represents  the  high  resolution  focused  image 
of  the  point  acatterer. 


Figure  9.  Focused  image  and  bias  components 


The  other  two  terms  of  Eq.  (13)  are  interferometric  bias  components.  The  first  is 
constant  throughout  the  plane  and  its  height  is  determined  by  the  strength  of  the  reference 
signal,  B.  The  second  bias  term  is  dependent  on  the  radar  signal  and  results  in  the 
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formation  of  a  ridge  in  tba  rang#  location  of  tha  point  targat  aa  shown  in  Pig.  9.  Since 
each  point  scattecer  in  a  target  scene  will  have  one  of  these  bias  ridges  associated  with 
it.  they  aust  be  removed  before  a  quality  iaage  can  be  displayed.  The  constant  bias  tern 
should  also  be  removed  to  improve  the  contrast  of  the  displayed  image. 

Several  techniques  are  available  for  removing  the  bias  components.  One  technique 
employs  a  second  CCD  detector  array  on  which  only  the  signal  dependent  bias  tern  is 
computed.  The  video  signal  output  from  this  CCD  is  electronically  subtracted  fron  the  video 
output  of  the  original  CCD  to  produce  the  bias  free  image.  This  technique,  is  implemented 
using  a  beam  splitter  positioned  before  the  second  AOD  in  Pig.  •.  The  light  that  is  split 
away  fron  the  main  bean  is  range  focused  onto  the  second  CCD.  without  azimuth  processing, 
resulting  in  a  charge  distribution  that  is  proportional  to  the  signal  dependent  bias 
component  of  Eq.  (13). 

Another  appro^^h  to  bias  removal  is  to  employ  a  specially  designed  CCD  detector  array 
which  electronically  subtracts  the  bias  on  the  CCD  chip  itself. *  in  this  technique, 
circuitry  which  is  fabricated  directly  on  the  CCD  substrate,  is  used  to  incrementally 
bleed  off  the  bias  charge  as  it  builds  up  in  the  pixels.  This  approach  maximizes  the 
usable  dynamic  range  of  the  CCD. 

In  a  third  bias  renoval  technique  the  focused  SAR  image  is  generated  on  an  optical 
spatial  carrier  frequency.  The  bias  components  are  not  modulated  by  the  spatial  carrier 
and  are  removed  by  electronic  post-processing  of  the  CCD  video  output.  The  carrier  is 
generated  either  in  the  range  or  azimuth  dimension  by  introducing  the  appropriate  frequency 
ahifts  in  the  electronic  aignals.  Demodulation  consists  of  electronic  filtering  to  detect 
only  those  components  which  are  on  the  carrier,  followed  by  envelope  detection  to  remove 
the  carrier  frequency  from  the  image. 


Results 


The  real-time  imaging  ability  of  the  AO/CCD  system  is  evaluated  by  measuring  the  impulse 
response  of  the  processor.  Electronics  are  used  to  simulate  the  backscattered  radar 
signals  that  would  be  received  from  a  single  point  scatterer  in  the  target  field.  The 
simulated  radar  returns  are  then  summed  to  the  reference  signal  and  applied  to  the  AOD  of 
the  processor.  An  isometric  display  is  used  to  collect  and  Btore  a  frame  of  the  CCD 
output  and  displays  the  focused  image  of  the  point  scatterer  in  either  a  2-D  or  3-D 
perspective  format  for  analysis. 

An  example  of  the  undemodulated  output  of  the  processor,  when  displayed  in  3-D 
perspective,  is  shown  in  Fig.  10.  These  data  are  from  tests  of  the  original  processor 
which  used  a  mask  for  the  azimuth  compression.  The  focused  image  of  a  simulated  point 
scatterer  is  visible  as  a  narrow  spike  which  sits  upon  the  unwanted  bias  ridge  located  in 
the  target's  range  bin.  The  usual  side-lobe  structure  of  a  focused  SAR  scatterer.  in  the 
azimuth  dimension,  is  evident  along  the  bias  ridge.  The  CCD’s  fixed  pattern  noise  as  well 
as  the  nonuniformity  in  the  illumination  of  the  reference  beam  are  also  visible  on  the 
floor  beneath  the  ridge.  To  test  the  resolution  limitations  of  the  CCD  in  the  Processor, 
the  simulated  target  for  this  data  had  a  SBWP  in  excess  of  100  in  each  dimension. 
Consequently,  the  focused  image  is  just  several  pixels  across  and  the  individual  pixel 
structure  is  quite  evident. 

Pig.  ll  is  an  isometrical ly  displayed  image  of  a  point  scatterer  when  demodulation  is 
employed.  The  unfocused  simulated  point  scatterer  in  this  example  has  SBWPs  of 
approximately  4a  and  100  in  the  azimuth  and  range  dimensions  respectively.  For  this  data 
the  focused  image  is  modulated  by  an  optical  spatial  carrier  frequency  in  the  azimuth 
dimension.  An  electronic  filter  is  used  to  remove  the  bias  components.  This  demodulation 
scheme  is  also  very  effective  in  removing  the  fixed  pattern  noises  associated  with  the  CCD 
and  laser  illumination,  as  is  evident  in  Fig.  ll.  The  dynamic  range  for  a  single  simulated 
point  scatterer  was  measured  to  be  in  excess  of  100:1. 


A  maskless  architecture  which  can  electronically  change  its  azimuth  filter,  like  that 
shown  in  Fig.  3.  has  been  built  and  its  impulse  resonse  characterized.  Both  framing  and 
scrolling  modes  of  operation  were  demonstrated.  In  the  framing  mode  a  staring  CCD  was 
used,  and  the  azimuth  filter  signal  was  electronically  shifted  in  the  AOD  during  the 
integration  period  to  perform  the  azimuth  compression  operation.  Fig.  13  is  an 
electronically  shifted  version  of  the  interferometrlcally  generated  azimuth  filter  shown  in 
Fig.  t  as  it  would  appear  at  one  increment  of  the  azimuth  correlation.  In  this  mode  the 
azimuth  pulse  compression  achieved  is  determined  by  the  window  size  of  the  shifting  azimuth 
signal  and  not  by  the  CCD  aperture.  A  simulated  point  scatterer  with  a  sbkp  of  40  in  the 
azimuth  dimension  was  successfully  focused. 

Fig.  13  is  an  image  of  a  simulated  point  scatterer  focused  with  the  scrolling  mode  of 
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operation.  In  this  implementation  the  aziautb  compression  ia  acieved  by  operating  the  CCX 
detector  array  in  the  shift-and-add  aode.  The  aziauth  reference  aignal  that  ia  loaded  into 
the  aecond  AOD  ia  the  saae  (and  not  ahifted  in  tiae)  for  each  radar  pulse.  For  this 
experiaent  the  aiaulated  acatterer  had  an  aziauth  phase  history  which  aatched  that  of  a 
range  bin  near  the  center  of  the  filter  shown  in  Fig.  6.  The  focused  iaage  of  Fig.  13 
was  generated  using  the  aziauth  carrier  deaodulation  sebeae  that  has  been  described 
previously.  The  pulse  coapression  achieved  is  approximately  35  and  75  for  the  aziauth  and 
range  diaensions  respectively,  which  accounts  for  the  oblong  shape  of  the  focused  spot. 


Figure  1>.  Example  of  undemodulated  output. 


Figure  11.  Example  of  deaodulated  output. 
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Figure  12.  Electronically  shifted  azimuth  reference  function. 


Figure  13.  Simulated  point  acatterer  focuaed  in  real  time 
with  the  programmable  (maak-leaa)  architecture. 
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Uataci 

Time  end  space  integrating  folded  spectrum  techniques  utilising  acousto-optic  devices 
(AOD)  es  l-D  input  transducers  ere  investigated  for  e  potential  application  as  wideband, 
high  resolution,  large  processing  gain  spectrum  analysers  in  the  search  for  extra¬ 
terrestrial  intelligence  (SETl)  program.  The  space  integrating  Fourier  transform  performed 
by  a  lens  channelises  the  coarse  spectral  components  diffracted  from  an  AOD  onto  an  array 
of  time  Integrating  narrowband  fine  resolution  spectrum  analysers.  The  pulsing  action  of  a 
laser  diode  samples  the  interferometrically  detected  output,  aliasing  the  fine  resolution 
components  to  baseband,  as  required  for  the  subsequent  CCD  processing.  The  raster  scan 
mechanism  incorporated  into  the  readout  of  the  CCD  detector  array  is  used  to  unfold  the  2D 
transform,  reproducing  the  desired  high  resolution  Fourier  transform  of  the  input  signal. 


Int redaction 

The  Search  for  Extra-Terrestrial  Intelligence  (SETI)  is  an  ambitious  program  to 
examine  77)  of  the  nearest  solar  type  stars  as  well  as  the  entire  celestial  sphere  for  any 
evidence  of  Intelligent  microwave  activity,  either  beamed  at  us  or  leaked  from  a 
civilization's  internal  communications1.  The  Interstellar  distances  are  so  large  and  the 
resulting  l/R3  attenuation  is  ao  great  that  the  receiver  sensitivity  to  a  signal  burried 
in  cosmic  background  noi6e  must  be  as  large  as  possible.  Without  a  priori  knowledge  as  to 
the  transmitted  signal  structure  ideal  matched  filters  cannot  be  constructed,  however  a 
good  assumption  is  that  a  transmitted  beacon  would  have  a  narrow  band  highly  coherent 
structure  in  a  sea  of  broadband  white  noise.  Thus  a  narrow  bandpass  filter,  with 
resolution  as  small  as  1-100  Bz.  could  achieve  enough  processing  gain  to  detect  the 
presence  of  an  intelligent  CW  signal.  Since  the  preferred  frequency  for  interstellar 
microwave  communication  could  conclevably  lie  anywhere  from  .1-10-100  GHz.  then  from  10s 
to  101X  frequency  measurements  must  be  made  for  each  resolvable  spot  on  the  celestial 
sphere  observed  by  the  radio  telescope.  If  these  measurements  were  performed  sequentially 
with  a  swept  local  oscillator  tuned  bandpass  filter  then  as  much  as  a  million  years  of 
observation  time  could  be  required.  A  much  more  practical  approach  would  be  to  build  a 
wideband,  high  resolution  spectrum  analyzer  with  a  million  or  more  parallel  channels  of 
band  pass  filters  thereby  cutting  down  observation  time  to  on  the  order  of  a  year. 
Currently  two  approaches  are  being  pursued,  a  digital  multi-channel  spectrum  analyzer 
( MCSA) 1  with  a  tree  configuration  of  DFT  and  FFT  subunits,  and  an  analog  acousto-optic 
folded  spectrum  processor  a6  reported  in  this  paper. 

The  advanced  state  of  the  art  of  wideband  acousto-optic  (AO)  Bragg  cells  make  them 
ideal  candidates  for  entering  l-D  data  into  an  optical  signal  processing  system,  and  the 
Fourier  transforming  property  of  a  lens  makes  the  implementation  of  real-time  spectrum 
analyzers  with  1000  resolvable  frequencies  routine.  In  this  paper  we  explore  some  possible 
approaches  to  performing  narrow  band  time  Integrating  (TI)  spectrum  analysis  on  each  of 
the  103  channels  of  a  space  integrating  (SI)  A0  spectrum  analyser,  thereby  obtaining  a 
high  resolution  folded  spectrum  through  time  and  space  integration  (TSI). 


Folded  Spectrum  Processing 

The  concept  of  the  Folded  Spectrum  was  Introduced  by  Thomas3,  who  showed  that  the  2-D 
Fourier  transform  of  a  raster  scanned  signal  was  an  orthogonally  raster  scanned  version  of 
the  long  l-D  spectrum  of  the  original  signal.  This  is  schematically  illustrated  i/i  Fig.  l. 
The  folded  spectrum  is  ideal  for  an  optical  signal  processing  system  since  it  utilizes  the 
2  available  spatial  coordinates  to  perform  a  high  resolution  spectrum  analysis  that  would 
be  impossible  in  a  l-D  system  due  to  the  limitations  in  space  bandwidth  product  of  l-D 
devices.  This  processing  operation  can  be  performed  in  real  time  by  raster  scanning  a  very 
long  input  signal  s(t)  onto  a  2-D  spatial  light  modulator  (SDK),  and  using  the  2-D  space 
integrating  Fourier  transform  operation  performed  by  a  spherical  lens.  After  the  complete 
2-D  raster  is  formed,  coherent  light  is  passed  through  the  SLH  and  the  resulting  amplitude 
distribution  f(x.n)  is  Fourier  transformed  by  the  lens.  The  power  spectrum  lF(uc,v*)|3  is 
detected  by  a  2-D  charge  coupled  device  (CCD)  detector  array  at  the  back  focal  plane.  The 
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orthogonally  oriented  raster  readout  of  the  CCD  turns  the  2-D  power  spectrum  back  Into  a 
high  resolution  l-D  power  spectum  16(f)  I  .  at  a  rate  of  up  to  <0  such  transformations  each 
second.  However,  the  avellability  of  highly  nature  CCD  devices  with  up  to  2000  a  2000 
plsels  can  not  be  fully  utilised  because  of  the  lower  resolution  and  dynastic  range  of 
currently  available  2-D  SLMs.  Thus  an  architecture  for  performing  the  high  resolution 
folded  spectrun  operation  without  the  need  for  2-D  SLMs  la  highly  desirable. 

Turpin9  and  Heilman4  have  suggested  such  an  approach  utilising  acousto-optic  devices 
(AODs)  in  sn  interferometric  tine  integrating  configuration.  Zn  this  approach  a  2-D  array 
of  local  oscillators  with  coarse  and  fine  frequencies  in  x  and  y  is  produced  by  orthogonal 
AODs  to  which  fast  and  slow  chirps  are  applied  respectively.  When  a  frequency  component  of 
the  input  signal  matches  that  of  a  particular  local  oscillator,  a  baseband  heterodyne 
component  is  generated,  and  a  time  integrated  peak  la  created  at  that  location, 
proportional  in  amplitude  to  the  amplitude  of  the  corresponding  Fourier  component.  Since 
this  approach  involves  interferometric  detection,  a  bias  term  will  be  generated  due  to  the 
local  oscillator  reference  and  a  signal  dependent  bias  will  occur  uniformly  throughout  the 
detector  array.  These  components  can  be  separated  by  placing  the  desired  heterodyne  term 
on  a  spatial  carrier.  However  in  a  white  noise  environment  as  envisioned  for  the  SETI 
search  with  a  weak  narrow  band  CW  peak,  the  signal  dependent  bias  term  will  produce  a 
large  bias  because  all  its  frequency  components  are  incoherently  detected  et  each  CCD 
pixel,  thereby  using  up  the  available  CCD  dynamic  range.  Thus  the  2-D  time  integrating 
technique  for  folded  spectrum  processing  suffers  in  a  multisignal  environment  from  a  large 
signal  dependent  bias  term,  and  places  too  large  a  requirement  on  CCD  dynamic  range. 

A  hybrid  approach  that  utilizes  the  l-D  space  integrating  Fourier  transformation 
property  of  a  lens  in  one  dimension  followed  by  an  interferometric  time  integrating  fine 
resolution  spectral  analysis  can  combine  the  best  features  of  the  2-D  SI  and  2-D  T1 
approaches  to  folded  spectrum  processing.  This  approach  utilizes  a  standard  space 
integrating  acousto-optic  spectrum  analyzer  (Fig.  S)  to  perform  the  coarse  spectral 
analysis  without  introducing  a  signal  dependent  bias  term.  The  number  of  resolvable  coarse 
frequency  bins  is  limited  by  the  time  bandwidth  product  of  the  AOD  and  the  input 
apodization  to  approximately  TaB-l000.  The  doppler  frequency  shift  associated  with 
acousto-optic  Bragg  diffraction  produces  a  linear  spatial  dependence  of  the  temporal 
frequency  at  the  output  spectrum  that  must  be  converged  to  baseband  at  all  positions  for 
further  time  integrating  processing  on  a  CCD.  Bader9'6  proposed  a  way  to  do  this  with  a 
spatially  distributed  local  oscillator  (DLO)  reference  wave  which  la  produced  with  an 
auxiliary  AOD  that  has  a  repetitive  wide  band  signal  applied  to  its  transducer. 
Interferometric  detection  of  the  signal  and  reference  Fourier  spectras  produces  narrowband 
baseband  signal  components  at  each  output  location.  These  narrowband  signals  can  be  used 
to  produce  a  time  integrating  fine  frequency  analysis  in  the  orthogonal  direction  on  a  2-D 
CCD  through  the  use  of  the  chirp  transform  algorithm  by  premultiplying  each  narrowband 
signal  with  a  slow  chirp  and  then  convolving  with  a  matched  chirp  using  another  AOD.  This 
type  of  system  has  a  less  severe  signal  dependent  bias  build  up  problem  because  only 
signals  within  a  single  coarse  frequency  bin  contribute  any  bias  to  that  bin.  In  this 
paper  we  will  present  an  alternative  approach  to  time  and  space  integrating  folded 
apectrum  processing. 

This  method,  which  utilises  pulsed  laser  diodes,  was  originally  proposed  by 
Psaltis7*6,  and  is  illustrated  schematically  in  Fig.  2.  A  very  long  wideband  signal  is  to 
be  optically  processed  utilizing  an  acousto-optic  device  as  the  input  transducer.  However, 
since  the  limited  time-bandwidth  product  of  the  AOD  will  not  allow  the  entire  signal  to  be 
entered  into  the  AOD  simultaneously,  we  will  successively  slide  overlapping  portions  of 
the  long  signal  into  the  AOD  and  freeze  the  acoustic  motion  by  pulsing  the  illuminating 
laser  diode  with  a  very  narrow  pulse.  For  each  laser  diode  pulse  we  have  a  l-D  spatial 
representation  Of  part  of  the  input  signal  aa  an  optically  coherent  wavefront,  and  on 
successive  pulses  we  will  transduce  successive  portions  of  the  input  signal  into  the 
optical  system.  Thus  we  have  transformed  the  long  signal  into  a  2-D  raster  of  space  (x), 
and  time  or  pulse  number  (n).  The  transformation  performed  by  the  AOD  illuminated  with  a 
repetitively  pulsed  laser  diode  is  given  by 

H-l 

f(x.n)  -  ^  s(t— x/v)  rect(x/A)  *(t-nT) .  <l) 

n-0 

Xn  this  expression  v  is  the  acoustic  velocity  of  the  travelling  wave  AOD.  A  is  the  AOD 
width,  and  T  is  the  laser  diode  pulse  repetition  Interval,  if  A>vT  the  raster  is 
oversampled,  which  means  that  successive  raster  lines  are  overlapping.  We  perform  the 
desired  long  l-D  Fourier  trensform  on  the  input  signal  s(t),  with  a  2-D  transform  on  its 
oversampled  2-D  raster  representation  f(x,n>.  Because  of  the  separability  of  the 
multidimensional  Fourier  kernel,  a  2-D  transform  can  be  performed  as  N  l-D  transforms 
along  one  axis,  followed  by  H  l-D  transforms  along  the  orthogonal  axis.  This  cascaded 
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2-D  Space  Integrating  Folded  Spectrum 


a) 


b) 
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Pig.  l.  a)  Relationship  between  a  long  l-D 
signal,  its  high  resolution  spectrum,  the 
folded  spectrum,  and  the  signal's  raster 
representation,  b)  A  space  integrating 
folded  spectrum  processor. 


Fig.  2.  Time  and  Space  integrating 
folded  spectrum  processor  showing  the 
conversion  to  a  space-time  raster, 
spatial  Fourier  transformation  followed 
by  array  of  temporal  Fourier  transforms. 


system  can  be  implemented  by  performing  a  spatial  Fourier  transform  with  a  lens  for  each 
of  the  N  laser  diode  pulses,  producing  an  intermediate  data  set  Fx(u.n>.  which  is  also  a 
space-time  raster.  This  is  followed  by  an  array  of  time  integrating  Fourier  transform 
modules  that  utilise  the  second  spatial  dimension  (y)  to  perform  the  desired  accumulation 
of  partial  products.  After  a  succession  of  N  laser  diode  pulses  the  full  folded  spectrum 
is  produced  in  a  2-D  format  on  a  CCD  detector  array.  The  2-D  spectrum  can  be  very  simply 
unfolded  back  into  the  desired  long  l-D  spectrum  by  utilizing  the  raster  readout  mechanism 
incorporated  in  the  CCD  itself.  The  resulting  system  utilizes  the  mature  component 
technologies  of  acousto-optics,  charge  coupled  devices  and  laser  diodes  to  produce  a 
valuable  real-time  signal  processing  module  for  high  resolution  spectral  analysis. 


Space  integrating  Spectral  Snalyaei  Kith  a  Bailed  u«er  Pi ode 

The  operation  of  a  space  integrating  (61)  acousto-optic  spectrum  analyzer  is 
explained  with  reference  to  Fig.  I.  A  collimated  coherent  o£(ical  plane  wave  of  wavelength 
X  is  Incident  upon  the  AOD  at  the  Bragg  angle,  #B-  -sin  i/2  «— lf(/2v,  in  order  to 
maximize  the  optical  power  coupled  into  the  first  order  diffracted  beam.  In  this 
expression  f«  is  the  transducer  center  frequency.  •>v/f«  is  the  midband  acoustic 
wavelength,  and  v  is  the  acoustic  velocity.  A  bandllmited  signal  is  mixed  to  the  AOD 
center  frequency  f,.  producing  an  octave  bandwidth  signal  s(t>.  that  is  amplified  and 
applied  to  the  piezoelectric  transducer,  thereby  launching  an  acoustic  wave  replica  of 
s(t)  into  the  photoelastic  medium.  The  acoustic  wav  creates  a  travelling  wave  volume 
index  pertubatlon  through  the  photoelastic  effect,  which  Bragg  diffracts  some  of  the 
incident  light  into  the  first  order  diffracted  optical  replica  of  a  single*  sideband 
version  of  the  portion  of  the  signal  s(t)  that  is  currently  within  the  AOD  aperture  A.  In 
the  frequency  domain  this  can  be  viewed  as  each  Fourier  component  6(f)  of  the  signal  s(t> 
within  the  AOD  bandwidth  B»2f(/I.  producing  a  diffracted  plane  wave  of  aperture  A 
propogating  at  an  angle  S^-if/lv  with  respect  to  the  optic  axis,  doppler  shifted  by  the 
frequency  f  due  to  the  acoustic  wave  motion.  This  diffracted  field  propogates  through  a 
distance  F  and  is  incident  on  a  Fourier  Transforming  lens  of  focal  length  F.  so  that  at  a 
diatance  F  behind  the  lens  the  spatial  Fourier  transform  of  the  signal  within  the  AOD  is 
formed.  At  the  back  focal  plane  the  field  observed  is 
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PU'.t)  “  JA  stt-x/v)  a*  «3-t 

-  Ja  IJb  8<f)  •3**£<t~a/v)  «]  .-!»■« */»■?  a* 

-  J  8(f)  A  sinclA<x'/XF-f/v)I  df  «3*t 

•  Cv  S(x*v/XF)  #3 2«vx't/XF  #j«t)  •  A  ainc(Ax'/XF).  (2) 

In  thin  expression  x  is  the  apetial  coordinate  along  the  axia  of  acouatic  propogatlon,  x* 
la  the  apatial  coordinate  at  the  Fourier  plane,  and  a>2*c/x  ia  the  optical  radian 
frequency.  The  symbol  *  repreaenta  the  convolution  operation.  Me  have  neglected  effecta  of 
input  apodlzatlon,  acouatic  attenuation,  aniaotroplc  diffraction  and  band  limitation,  as 
well  aa  other  higher  order  effecta.  The  exact  doppler  temporal  phaae  hiatory  of  each 
Fourier  component  ia  reproduced  at  the  back  focal  plane,  but  the  apatial  repreaentatlon  of 
the  apectrum  ia  blurred  by  the  Fourier  tranaform  of  the  finite  aperture  function  of  width 
A  thereby  limiting  the  effective  frequency  reaolutlon  to  »f-l/Ta-v/A.  where  Ta  ia  the 
acouatic  tranait  time  across  the  aperture.  This  shows  that  the  number  of  independent 
analog  samples  stored  within  the  AOD  at  any  particular  inatant.  which  ia  given  by  the  time 
bandwidth  product  T.B.  also  gives  the  effective  number  of  independent  frequencies  that  can 
be  determined  in  the  spatial  Fourier  tranaform  plane.  The  actual  frequency  resolution  is 
limited  by  the  AOD  finite  aperture  sine  convolved  with  the  transforms  of  the  optical  and 
acoustic  apodization  functions,  in  order  to  produce  an  overall  blur  spot  C(x’/xf)  which 
yields  somewhat  worse  frequency  resolution  than  1/Ta.  Normal  operation  of  an  acousto-optic 
spectrum  analyzer  involves  the  square  law  detection  process  on  a  1-D  array  of  integrating 
photosensors,  which  incoherently  accumulate  charge  for  a  time  T*  in  order  to  Improve  the 
signal  to  noise  ratio. 


Fix')  -  JJ'  If ( x ’ . t ) I  *  dt  -  JJ'  ls(x ’v/xf)  •  Q<x'/XF)I*  dt  (S) 


The  output  of  this  type  of  apectrum  analyzer  is  a  power  spectrum  of  the  signal  sit)  with  a 
resolution  limited  by  the  blur  spot  Qiu),  with  a  normalized  spatial  frequency  variable 
U“x '/ XF .  For  a  single  sinusoidal  input  of  frequency  f*  input  to  the  apectrum  analyzer, 
sit)  -  2  a  cost 2 a f ’ t ) ,  with  a  single  sided  temporal  Fourier  spectrum  given  by 
Stf)  -  a  *{f-f>.  the  time  integrated  output  of  the  apectrum  analyzer  ia  given  by 

Ftu)  -  T'lalViu-f */v).  (4) 

A  heterodyne  detection  technique  can  be  employed  by  the  addition  of  a  simple  plane 
wave  reference  beam.  The  instantaneous  output  of  such  an  Interferometric  spectrum  analyzer 
has  a  linear  apatial  dependance  of  the  doppler  induced  temporal  frequency  that  is  given  by 


Fiu.t)  -  |(Siuv)  «3a"vut  aj«t]  •  q(U)  4  t  e^*tlI 

-  Is(uv)*0(u) I*  ♦  I r I  *  ♦  2  r  [|Siuv)l  cos(2«vut+D(uv) ) ]»Q(u) .  i5> 


Where  the  amplitude  and  phase  of  the  complex  apectrum  sif >  —  I  Si f > le^8<£ *  are  reproduced 
as  temporal  modulations  of  each  resolved  frequency  bin  which  is  spatially  blurred  due  to 
the  apodization.  For  the  case  of  the  single  sinusoidal  input  tone  at  a  frequency  f’,  with 
amplitude  la  I  and  phase  o.  the  heterodyne  detected  instantaneous  output  is 
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The  temporal  modulation  on  the  last  term  thus  reproduces  the  input  sinusoid  in  both 
amplitude  and  phase,  and  could  be  used  as  the  input  to  a  fine  resolution  time  Integrating 
processor  if  we  first  heterodyne  it  to  baseband.  A  repetitively  pulsed  light  source  is  a 
simple  and  effective  means  of  accomplishing  this  as  long  as  the  pulse  width  «  is  less  than 
the  Inverse  of  the  bandwidth  of  sit),  and  much  greater  than  the  optical  period  of 
oscillation.  When  these  conditions  are  satisfied  we  can  consider  the  laser  diode  pulsed 
modulation  to  be  approximated  by  a  series  of  delta  functions  separated  by  a  time  T. 


p(t) 


}  *<t-nT> . 
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This  ittlti  of  delta  functions  will  act  as  sampling  impulses  on  tha  interferoaetrlcally 
detected  temporal  Modulation  praaant  at  the  output  plane.  It  la  convenient  to  consider  the 
input  taaporal  frequency  to  be  broken  up  into  a  coarse  and  fine  part  by  choosing  the 
closest  baraonlc  of  the  laser  diode  pulse  repetition  frequency  as  the  coarse  tern  and  the 
offset  froa  this  frequency  as  the  bandlimited  fine  resolution  component.  Thus  we 
substitute  f'-k/T*ft  into  equation  ft.  where  k-mod./.f*  is  an  integer  and  ft-resj/.f *<l/T. 

For  the  case  of  repetitively  pulsed  laser  illumination  the  heterodyne  output  or  the  AO 
spectrua  analyzer  for  a  single  applied  sinusoidal  tone,  la  given  by 

F(u.t)  -  l  lal*G*(u-(k/T*»>/v)  ♦  Ir I ilalr  0<u-<k/T*»)/v>  cos(2n<k/Tf»>t*n) j  p(t).  <•) 


The  fine  frequency  component  *  will  not  wove  the  blur  spot  Q(u)  by  a  significant  amount 
and  can  be  dropped  from  within  O(u).  The  coarse  frequency  component  k/T  will  be  sampled  by 
the  laser  diode  pulses  at  times  t-nT  resulting  in  an  argument  within  the  cosine  function 
of  nk2«,  with  n  and  k  both  Integers,  so  that  this  term  can  be  dropped  leaving  only  the 
fine  frequency  modulation.  Thus  for  the  nth  laser  diode  pulse  at  time  t-nT  the  sampled 
output  can  be  approximated  as 


F(u.nT)  *  lal *Q*(u-k/Tv)  ♦  lrl*+  2la!r  Q(u-k/Tv)  cos(2*»nT+B) .  (9) 


Thus  for  a  single  sinusoidal  input  the  interferometric  output  of  the  space  integrating 
spectrum  analyzer  illuminated  with  a  serlea  of  delta  functions  can  be  seen  to  consist  of  a 
signal  dependent  bias  term  located  at  the  position  corresponding  to  the  coarse  frequency 
component,  a  uniform  reference  bias  term  and  a  sampled  interferometrically  detected  spot 
located  at  the  coarse  frequency  locus  and  oscillating  in  time  at  the  fine  frequency  ft. 
with  phase  0.  This  effect  of  the  sampling  pulse  train  is  usually  referred  to  as  aliasing 
and  is  considered  undesirable.  It  indicates  that  the  sampling  rate  is  too  low  for  the 
given  signal  bandwidth,  and  it  results  in  different  parts  of  the  signal  spectrum  folding 
over  on  top  of  each  other  thereby  producing  Invalid  signal  components.  However  in  this 
case,  the  coarse  frequency  channelization  of  the  SI  spectrum  analyzer  effectively 
separates  in  space  the  various  frequency  components  that  could  alias  with  each  other.  It 
16  Important  to  make  sure  that  the  sampling  rate  is  fast  enough  to  avoid  aliasing  of  the 
bandlimited  signals  within  each  coarse  frequency  blur  spot  Q(u).  Since  the  bandwidth  of 
the  signal  information  within  each  blur  spot  is  Increased  over  i/Ta  due  to  the  apodization 
effects,  we  will  assume  that  an  appropriate  bandwidth  would  be  2/Ta.  To  adequately  sample 
these  bandlimited  signal  components  the  Ryquist  criterion  indicates  that  we  should  sample 
at  leaEt  twice  as  fast  as  the  highest  frequency  signal  component  present,  thus  the  minimum 
sampling  rate  should  be  1/T>4/Ta.  This  indicates  that  the  laser  diode  should  be  pulsed  at 
least  4  times  as  an  acoustic  signal  transits  across  the  laser  beam  aperture  illuminating 
the  AOD  in  order  to  produce  the  appropriately  oversampled  space-time  raster. 


■uni 


Fig.  ft.  The  space  integrating  acousto-  Fig.  4.  Interferometric  time  integrating 

optic  spectrum  analyzer.  DPT  narrowband  spectrum  analyzer  with 

phase  locked  stepped  frequency  reference. 


Ziac  Integrating  BEX  based  Fine  Resolution  Processor 

A  narrowband  fine  resolution  spectrum  analysis  operation  requires  the  coherent 
accumulation  of  data  samples  for  a  period  at  least  as  long  as  the  inverse  spectral 
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resolution,  ror  this  reason  a  61  AO  spectrum  analyser  la  Halted  in  resolution  to  the 
Inverse  aperture  tine  of  the  AOD.  In  order  to  obtain  a  higher  resolution  apectrun  analysis 
with  AODs  a  time  integrating  (T 1)  approach  nust  be  utilised.  Coherent  accumulations  can  be 
carried  out  on  an  integrating  charge  coupled  device  (CCD)  detector  array  as  long  as  the 
thermally  generated  detector  dark  current  and  optical  bias  contributions  do  not  saturate 
the  desired  signal  components.  With  typical  CCD  device  defect  densities,  thermal 
generation  rates  and  signal  veil  capacities  it  should  be  possible  to  Integrate  for  a  full 
second,  obtaining  l  Hi  resolution  capabilities,  and  with  cooled  detectors  it  would  be 
possible  to  Integrate  even  longer.  For  the  SET!  program  these  resolution  capabilities 
should  be  more  than  sufficient  since  spectral  coherence  of  better  than  l  Hi  would  be  very 
difficult  to  obtain  after  propogating  through  the  interstellar  medium  and  being  doppler 
shifted  by  both  transmitter  and  receiver  motions. 


The  required  operation  that  needs  to  be  performed  on  the  output  of  each  coarse 
frequency  bin  of  the  interferometric  61  spectrum  analyser  with  a  pulsed  LD  reported  in  the 
previous  section  is  a  narrowband  discrete  Fourier  transform  (DFT).  The  DPT  is  the  discrete 
version  of  the  Fourier  transform  as  is  appropriate  for  sampled  data  streams  such  as  that 
produced  by  the  interferometric  spectrum  analyser  illuminated  by  a  pulsed  laser  diode  .  If 
we  examine  the  third  term  in  Eq.  9  we  can  see  that  for  each  input  sinuaold  we  have  a 
sampled  fine  frequency  temporal  oscillation  s(n)  that  we  want  to  perform  a  DPT  on.  The  DPT 
is  defined  for  such  a  sampled  input  signal  s(n>  as 


6(m)  -  J  s(n) 


This  operation  la  a  vector  matrix  multiplication,  where  the  sampled  input  signal  s(n>  i6 
the  input  vector,  the  DFT  kernel  is  the  matrix,  and  S(m>  is  the  output  vector.  A  possible 
time  Integrating  interferometric  optical  lmplementaion  using  a  pulsed  laser  diode  16  shown 
schematically  in  Fig.  4.  The  light  from  a  repetitively  pulsed  laser  diode  is  split  into 
two  by  a  beam  splitter.  One  arm  illuminates  an  acousto-optic  modulator  that  has  a 
narrowband  signal  s(t)  applied  to  its  transducer  sampled  by  the  narrow  pulse  of  the  lased 
diode  producing  a  temporal  modulation  s(nT).  In  the  other  arm.  a  reference  AOD  with 
aperture  T.  equal  to  the  LD  pulse  repetition  interval,  is  schlieren  Imaged  onto  the  output 
CCD  array  where  it  is  lnterferometrically  combined  with  the  spatially  uniform  signal  beam 
producing  a  sinusoidal  spatial  fringe  pattern.  With  each  laser  diode  pulBe  a  new  column  of 
the  DFT  matrix  is  applied  to  the  reference  AOD  transducer,  and  propogates  across  the 
aperture  to  align  with  the  CCD  at  which  time  its  motion  is  frozen  by  the  LD  pulse  thereby 
imaging  that  column  onto  the  CCD.  Thus  the  reference  signal  is  analogous  to  a  raster 
scanned  version  of  the  DFT  matrix,  except  that  along  the  columns  a  continuous 
representation  is  used  which  is  later  sampled  by  the  spatially  discrete  CCD  pixel 
structure.  Eince  the  successive  columns  of  the  DFT  matrix  represent  sinusoids  of 
successively  higher  frequencies  the  reference  waveform  is  a  stepped  frequency  chirp,  with 
the  constraint  that  each  new  frequency  phase  resets  to  zero  phase  each  T.  The  reference 
signal  starts  at  frequency  f  and  frequency  steps  by  Af  each  time  T  which  is  analytically 
represented  as 


r(t)  ■  J  reett^f1]  cos [ 2 x ( f +nAf )  <t-nT)  1 , 

n-0 


This  signal  propogates  in  the  y  direction  at  a  velocity  v,  and  aligns  with  the  AOD  and  CCD 
apertures  at  the  times  of  the  laser  diode  pulses  as  given  in  Eq.  7.  The  spatial  modulation 
diffracted  by  the  AOD  on  the  nth  pulse  is  given  by 


r(y.n)  •  r(t-y/v)  rectly/vTl  Kt-nT) 
■  rectly/vTl  *jl"<f**»Af *y/v. 


Which  is  seen  to  be  a  finite  aperture  plane  wave  with  an  angular  spatial  frequency  that  is 
stepped  linearly  with  the  pulse  number  n.  The  lnterferometrically  detected  intensity 
pattern  on  the  nth  LD  pulae  is  found  by  combining  welgted  signal  and  reference  beams.  The 
signal  beam  propogates  at  an  angle  •  with  respect  to  the  starting  frequency  of  the 
reference,  resulting  in  a  spatial  carrier  of  spatial  frequency  e-sin*/l. 


I(y.n)  -  I  G  s(nT)  ♦  b  r(y.n)  I1 
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By  tin*  integrating  over  R  aucceasive  LD  pulaee  we  obtain  a  diecrete  summation  of  the 
interferometrlcally  detected  charge  diatrlbutiona  due  to  each  pulee. 


£v.’0 


I(y)  •  R  <Ig!**  Ibl*>  ♦  J  6  b  J  a(nT)  cos[2«(nAfy/v  *  ey)]  (14) 

n-0 

This  can  be  recognized  aa  the  diacrete  coaine  transform  of  the  sequence  a(nT).  with  an 
analyala  bandwidth  of  Af.  on  a  apatial  carrier  of  frequency  The  carrier 

allowe  a  bandpass  filter  operation  to  remove  the  bias  terms,  and  the  full  complex  DPT  can 
be  reconstructed  by  measuring  the  phase  angle  of  the  carrier  for  each  resolvable  frequency 
component.  The  CCD  is  composed  of  an  array  of  pixels  that  must  have  sufficient  resolution 
to  adequately  sample  the  apatial  fringe  structure  under  the  DPT  transform.  Por  a  pixel 
size  Sy.  the  number  of  pixels  per  cycle  of  the  fringe  structure  is  l/r*y.  and  should  be 
adjusted  to  4  to  •  pixels  per  cycle.  The  total  number  of  CCD  pixels  required  is  the 
product  of  the  DPT  apace  bandwidth  product  with  the  number  of  pixels  per  frequency 
resolution  element,  which  must  be  at  least  one  cycle,  thus  M  -  NAfT/yAy  >  4NAf T . 
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TSI  molded  Spectrum  gpeed  an  ZZ  DEX 

The  characteristics  of  the  T1  DPT  processor  described  in  the  previous  section  are 
complementary  to  those  of  the  SI  AO  spectrum  analyzer.  The  TI  DPT  processor  is  a  narrow 
band  processor  with  analysis  bandwidth  Af<l/2T.  and  high  resolution  of  l/NT.  The  SI  AO 
spectrum  analyzer  is  a  broadband  processor  with  bandwidth  B.  and  resolution  -2/T-,  which 
may  also  be  llmitted  by  the  CCD  pixel  size  which  has  a  frequency  width  of  vAx/XF.  Since 
the  TI  DPT  processor  is  a  l-D  system,  we  can  spatially  multiplex  an  array  of  such 
processors  in  the  orthogonal  dimension  by  using  a  2-D  CCD  detector  array.  Since  each  of 
the  TI  DPT  processors  in  the  array  needs  to  perform  the  same  narrowband  spectrum  analysis 
operation,  and  each  signal  is  brought  down  to  baseband  by  the  pulsed  laser  diode,  then 
they  all  can  use  the  same  reference  AOD.  One  way  that  we  can  configure  a  2-D  acousto-optic 
folded  spectrum  processor  is  as  an  additive  Rach-fehnder  interferometer  with  a  SI  AO 
spectrum  analyzer  to  perform  coarse  frequency  analysis  in  the  x  dimension  in  one  arm  of 
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Pig.  S.  a)  Kach-Zehnder  Interferometer 
for  performing  TSI  folded  spectrum,  b) 
Crossectlon  through  TI  fine  resolution 
spectrum  analyzer  arm.  c)  Crossectlon 
through  61  coarse  resolution  spectrum 
analyzer  arm. 
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Fig.  f.  Impulse  response  for  TSI  folded 
spectrum  processor  for  a  single  tone 
input  at  frequency  f’»k/T*S,  showing 
uniform  bias. signal  dependent  bia6,  and 
Impulse  riding  on  carrier. 
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the  interferometer.  and  a  spatially  Multiplexed  array  of  TI  DPT  processor  a  in  the  other  era 
in  order  to  perfora  fine  frequency  analysis  in  the  y  diaension  on  each  coarse  frequency 
bln.  The  fine  frequency  analysis  bandwidth  At  should  be  equal  to  the  coarse  frequency 
resolution  per  pixel  in  order  to  produce  a  full  folded  spectrua  without  any  qeps. 

The  description  and  analysis  of  the  TSI  AO  folded  spectrua  processor  la  aade  with 
reference  to  Pig.  5,  which  schematically  illustates  the  Mach-Zehnder  architecture  in  the 
upper  half,  and  shows  cross-sections  of  the  fine  and  coarse  eras  in  the  bottom  half  of  the 
figure.  The  timing  of  the  system  is  controlled  by  a  10  MHz  stable  crystal  oscillator  that 
is  digitally  divided  by  100  to  produce  a  stable  100  KHz  pulse  train  used  as  the  laser 
diode  trigger.  The  laser  diode  is  biased  just  below  threshold  and  pulsed  with  a  SO  nsec 
pulse  every  10  ssec.  The  anamorphic  Gaussian  beam  profile  of  the  laser  diode  is  collimated 
by  the  spherical  lens  and  oriented  with  the  long  axis  along  the  x  direction  in  order  to 
optimally  illuminate  the  entire  SI  AOD  aperture.  Por  the  initial  single  tone  experiments 
reported  in  this  paper  the  beam  splitter  reflects  only  about  10*  of  the  light  to  the  SI 
arm  of  the  interferometer,  because  the  processing  gain  associated  with  the  spatial 
Integration  performed  by  the  Pourier  lens  collects  enough  light  to  make  this  arm  brighter 
at  the  output  plane,  so  the  optical  efficiency  can  be  increased  by  directing  more  light  to 
the  TI  arm.  Por  an  actual  SBTI  signal  environment  of  broadband  noise,  the  beam  ratio  can 
best  be  balanced  through  the  use  of  a  50%  beam  splitter.  In  the  SI  arm  a  cylindrical  lens 
with  power  in  y  focuses  the  light  to  a  narrow  slit  positioned  to  coincide  with  the  center 
of  the  diffracting  acoustic  beam,  and  incident  on  the  AOD  at  the  Bragg  angle.  The  AODs 
used  in  this  experiment  are  slow  shear  node  TeO«  devices  with  an  aperture  Ta*70»seconds 
and  a  bandwidth  B-40  MHz.  The  signal  s(t)  applied  to  the  transducer  of  AODl  produces  a 
diffracted  component  which  is  Pourier  transformed  in  x  by  the  following  spherical  lens, 
which  simultaneously  recollimates  in  y.  Thus  each  frequency  component  of  s(t)  produces  a 
uniform  slit  of  light  at  the  output  plane,  and  the  position  of  this  slit  varies  linearly 
with  the  input  coarse  frequency.  In  the  TI  arm  of  the  interferometer  a  cylindrical  lens 
with  power  in  x  is  used  to  focus  the  light  down  to  a  narrow  slit  along  y  which  is  incident 
on  AOD 2  at  the  Bragg  angle.  Only  a  10  ^second  portion  of  the  AOD  needs  to  be  uniformly 
illuminated  with  the  narrow  dimension  of  the  LD  elliptical  beam  profile.  The  reference 
signal  is  generated  by  incrementing  a  10  bit  digital  counter  with  each  LD  pulse,  and 
driving  a  10  bit  digital-to-analog  converter  in  order  to  make  a  1024  level  staircase 
lasting  10.24  msec.  This  signal  is  then  applied  to  a  phase  reBetable  voltage  controlled 
oscillator  whose  phase  is  reset  each  LD  pulse  producing  the  waveform  r(t)  of  Eq.  11.  which 
is  amplified  and  applied  to  AOD2.  The  diffracted  signal  from  AOD2  is  Pourier  transformed 
by  the  spherical  lens  which  recollimates  in  the  x  dimension  and  allows  a  bandpass  filter 
to  be  placed  in  the  transform  plane.  The  filtered  light  is  retransformed  in  y  by  the 
following  cylinder,  producing  an  image  of  the  signal  in  A0D2  with  the  appropriate  scale  so 
that  one  10  iisecond  sinusoid  fills  the  entire  CCD  aperture  E  in  the  y  dimension,  and  is 
uniformly  spread  out  in  the  x  dimension.  The  final  beamsplitter  recombines  the  two  beams 
at  an  adjustable  angle,  and  the  CCD  time  integrates  the  interferometric  product  between 
the  two  waveE  for  a  single  video  frame  time  of  14.7  msec.  The  CCD  vertical  syncronization 
signal  is  used  to  reset  the  10  bit  digital  counter  and  begin  another  folded  spectrum 
calculation  by  time  integrating  the  next  1024  laser  diode  pulses. 

The  operation  of  the  processor  can  be  described  analytically  by  combining  the  results 
of  the  previous  two  sections.  The  optical  field  incident  on  the  CCD  during  the  nth  pulse 
is  the  sum  of  the  reference  wave  acting  as  a  linear  spatial  frequency  modulation  in  the  y 
dimension,  with  the  spatially  Pourier  transformed  signal  within  the  aperture  of  AODl.  The 
photogenerated  charge  profile  detected  by  the  CCD  on  each  LD  pulse  is  the  modulus  squared 
of  the  field  incident  during  that  pulse.  Thus  the  time  integrated  interf erometrical ly 
generated  charge  distribution  recorded  on  the  CCD  after  a  full  frame  of  processing  is 
given  by  Eq.  15. 


N-l 

I(u.y)  I  b  ,ja«<**nAf>y/v  ♦  G  .jlztvf /v)y  f  f(x>n)  e-J2«ux  dx  ,2 
n-o 


-  N  lbl‘*  N  IG  JA  f(x.n)  *”j**ux  dxl* 


H-l 

4  2  b  G  5  l  }A  f(x.n)  e“3J*u*  dx  }  cos[2«(nAfy/v  4  sy)l  (ij) 

n-0 

The  phase  reset  reference  wave  starts  at  frequency  f  and  steps  through  N  discrete 
frequencies  separated  by  if,  and  the  angle  of  Incidence  in  the  y  direction  S  can  be 
adjusted  to  make  the  resulting  fringe  structure  at  a  desired  spatial  frequency 
v*e* (N-l ) Af / 2 v.  The  output  pattern  consists  of  a  uniform  bias  term  due  to  the  reference 


beam,  a  signal  dependant  bias  term  with  no  variation  In  the  y  dimension,  and  the  laBt  term 
which  is  recognised  as  the  2-D  Fourier  transform  of  f(x.n),  which  is  the  desired  folded 
spectrum  of  the  long  l-D  signal  s(t).  The  folded  spectrum  term  is  riding  on  a  spatial 
carrier  of  spatial  frequency  y  in  the  y  dimension  so  that  it  can  can  be  demodulated  from 
the  bias  terms  by  an  appropriate  electronic  bandpass  filter.  For  the  case  of  a  single 
sinusoidal  signal  of  frequency  f'-k/T+*.  amplitude  lal.  and  phase  0,  the  output  becomes 

N-l 

l(u.y)  -  5  I  b  .ja«<**n*f>y/v  «.  c  .ja«(.4f/v)y  ,  a(u-k/Tv>  ei*"*nT  ll 
n-o 

-  N  Ibl *4  N  G*  lal*  Q*  (u-k/Tv) 

4  2  G  lal  Ibl  Q(u-k/Tv)  N  sine [NT ( 6-Afy /H ) 1  COS(2*ry40)  (1C) 


This  pattern  is  the  single  tone  impulse  response  of  the  system  and  is  shown  schematically 
in  Fig.  c.  It  consists  of  a  uniform  bias  term,  a  signal  dependent  bias  ridge  at  the  coarse 
frequency  location  u-k/Tv.  and  the  folded  spectrum  impulse  of  amplitude  lal  riding  on  top 
of  the  ridge  at  fine  frequency  position  y-»H/Af.  The  impulse  is  on  a  spatial  carrier  of 
frequency  t  in  the  y  dimension,  with  phase  angle  0  which  will  vary  on  successive  frames 
according  to  its  super  fine  frequency  A»res«.,~C,  thus  processing  of  successive  frames  can 
achieve  even  finer  resolution.  The  resolution  of  Eq.  1C  is  given  by  the  width  of  the  sine 
function  and  i6  limited  by  the  integration  time  to  1/NT.  however  the  CCD  spatial  frequency 
response  will  apodize  the  DFT  and  decrease  the  achievable  resolution.  The  fine  frequency 
analysis  bandwidth  is  seen  to  be  Af  as  y  is  allowed  to  vary  over  the  CCD  height  E. 

Experimental  results  from  this  processor  are  shown  in  Fig.  7  for  a  fine  frequency 
analysis  bandwidth  Af-4  KHz.  The  processor  was  operated  with  a  coarse  frequency  resolution 
per  pixel  of  SO  KHz.  but  due  to  limitations  of  the  electronics  the  fine  frequency  analysis 
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Fig.  7  Experimental  results  for  the  TSI 
folded  spectrum  processor  of  Fig.  S. 
showing  crossectlons  through  the  coarse 
frequency  ridge  for  fine  frequencies  of 
a)  120  Bz  b>  240  Bz  c>  COO  Bz  d)  2100  Bz 


Fig.  ».  Architecture  for  performing  TSI 
folded  spectrum  using  a  TDI  CCD  to 
perform  a  fine  resolution  chirp  transform. 
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bandwidth  was  Halted  to  10  KBs  and  the  data  presented  In  Pig.  7  la  therefore  only  a 
portion  of  a  full  folded  spectrun.  Crosasections  along  the  bias  ridge  are  shown  In  pigs. 
7a-d  with  different  fine  frequency  Inputs.  The  bias  pedestal  drops  away  near  the  edge  of 
the  output  trace  indicating  the  region  of  processor  analysis  B»vT.  At  a  fine  frequency 
difference  of  120  Bz  the  constructive  peak  is  quite  large  and  well  away  from  the  edge.  At 
a  frequency  of  240  Bz  the  destructive  peak  has  moved  over  by  about  its  width  indicating 
that  a  resolution  of  120  Bz  or  better  has  been  achieved.  At. a  frequency  of  <oo  Bz  the  peak 
has  moved  over  much  farther  but  seems  to  be  broadening.  At  2100  Bz  it  is  clear  that  the 
peak  is  broadening  and  decreasing  in  size.  This  appears  to  be  due  to  the  analog  nature  of 
the  reference  waveform  generation  introducing  statistical  frequency  variation  that  produce 
larger  and  larger  phase  uncertainties  at  higher  frequencies.  This  problem  can  be 
alleviated  through  the  use  of  a  digital  buffer  memory  and  digital  to  analog  converter  in 
order  to  produce  the  reference  waveform.  Bowever  this  digital  buffer  would  need  to  contain 
1024  lines  of  1024  words  each  that  must  be  read  out  at  a  100  MHz  rate,  which  is  currently 
unavailable  to  us.  Por  this  reason  an  alternative  architecture  with  a  much  simpler 
reference  function  was  built  for  comparison  purposes. 

Time  Integrating  Chirp  Transform  fifl  XXU  CCD 

A  common  method  of  performing  spectral  analysis  with  analog  convolvers  is  the  chirp 
transform  algorithm.  This  algorithm  results  from  the  observation  that  the  Fourier  kernel 
can  be  decomposed  into  a  convolution  and  two  products  through  the  use  of  the  following 
identity. 


-2nir.  -  (n-m)  *  -  n*  - 


(17) 


This  expression  can  be  substituted  into  Eq.  10.  which  defines  the  desired  DPT. 
rearranged  to  yield  the  chirp  transform  expression. 

N-l  N-l 

S(m)  -  J  s(n)  e~j*xnm/N  „  exp(-jxm*/N)  J  Is(n)  exp(-j*n*/N> )  exp( j* (n-m) * /N) 
n-o  n«0 


and 


(18) 


An  examination  of  this  representation  indicates  that  we  can  accomplish  a  DPT  by  first  pre¬ 
multiplying  the  input  signal  with  a  chirp,  convolving  the  resulting  product  with  a  matched 
chirp,  and  finally  post  multiplying  the  convolver  output  with  a  matched  chirp  in  the 
Fourier  domain.  Often  only  the  power  spectrum  is  required  in  which  case  we  can  neglect  the 
final  post  multiplication  by  the  quadratic  phase  factor,  since  its  magnitude  is  unity 
everywhere. 

There  are  a  large  number  of  methods  for  performing  convolutions  with  time  integrating 
optical  techniques  utilizing  acousto-optics  and  charge  coupled  devices.  The  features  which 
must  be  incorporated  in  a  convolver  are  an  array  of  multiplications,  a  shift  operation  and 
an  integration.  An  architecture  we  have  used  with  great  success  for  chirp  correlations10 
requires  a  temporally  modulated  input,  a  fixed  chirp  reference  mask,  and  a  CCD  operated  in 
the  time  delay  and  integrate  (TDD  mode,  where  the  detector  time  integrates  in  a  sliding 
coordinste  frame.  The  CCD  readout  circuitry  is  modified  so  that  it  operates  in  a 
continuously  scrolling  fashion  referred  to  as  TDI  or  shift  and  add.  In  this  manner  the  CCD 
accumulates  photogenerated  charge  at  each  pixel  site  for  one  or  more  laser  pulses,  the 
charge  is  then  transfered  vertically  (y)  by  one  pixel  of  width  Ay.  and  each  pixel 
accumulates  more  charge,  adding  it  to  that  previously  detected.  By  the  time  a  pixel  has 
fully  traveresed  the  array  of  helgth  7,  it  has  accumulated  photogenerated  charge  from  each 
position  in  space  at  successively  delayed  times.  If  a  temporally  modulated  sampled  signal 
f(nT)  is  uniformly  incident  on  the  chirp  mask  c(y)“COB(by  )rect(y/Y),  and  then  imaged  on 
the  TDI  CCD  the  resulting  signal  that  scrolls  off  the  the  edge  of  the  detector  is  given  by 
the  convolution  of  the  temporal  signal  with  the  spatially  sampled  image  of  the  mask. 


I(mT)  -  J  f (nT)  c(may)  •  l(m-n)  -  J  f(nT>  c((m-n)Ay) 
n  n 


(  J  9 ) 


The  index  m  enumerates  the  output  samples  obtained  at  the  edge  of  the  CCD  at  successive 
times  mT.  We  can  use  this  convolver  to  configure  a  time  Integrating  interferometric  chirp 
transform  power  spectrum  analyzer  by  introducing  a  quadratlcal ly  phase  modulated 
reference  beam,  and  interfering  this  with  a  baseband  phase  nodulated  signal  beam  in  order 
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to  perform  on  interferometric  chirp  pre  multiplication  of  the  input  signal  aa  the  detected 
intensity  f <nT)"8<nT)cos<b(nT)  V  ),  where  V"Ay/T  is  the  TDI  CCD  shifting  velocity.  The 
resulting  time  Integrated  power  spectrum  output  would  be  obtained  by  demodulating  the 
Interferometric  product  term  from  the  bias  terms  and  squaring  the  chirp  transform 
electronically.  The  analysis  bandwidth  of  this  type  of  TDI  chirp  transform  spectrum 
analyzer  is  limited  by  the  sampled  mask  resolution  to  half  the  CCD  shift  rate  for  each 
sideband  of  the  reference  chirp.  A  two  sided  chirp  reference  can  cover  an  analysis 
bandwidth  equal  to  the  CCD  shift  rate.  A  feature  of  this  type  of  chirp  transform  is  that 
the  spectral  amplitude  decreases  linearly  away  from  the  center  frequency  as  doe6  the 
spectral  resolution,  due  to  a  decrease  in  the  matching  chirp  overlap. 

The  chirp  transform  spectrum  analyzer  can  be  readily  incorporated  in  the  TSI  folded 
spectrum  processor  by  including  a  quadratica 1 1 y  phase  modulated  reference  beam,  and  a 
chirp  reference  mask  Imaged  onto  a  TDI  CCD.  The  resulting  system  architecture  is  shown 
schematically  in  Fig.  •  and  can  be  seen  to  be  just  a  modification  of  the  previous  optical 
system.  The  analytical  desription  of  the  TSI  folded  spectrum  system  with  the  TDI  chirp 
transform  fine  resolution  processors  results  in  the  same  signal  and  bias  terms  as  in  the 
previous  system  and  shown  in  Fig.  6.  However  the  TDI  approach  has  the  advantageous  feature 
that  it  averages  coherent  optical  artifacts  and  CCD  pixel  noise  along  the  shifting  column 
thereby  minimizing  the  system  fixed  pattern  noise.  The  system  output  is  given  by 


F(u.m)  -  ^  I  f(x,n)  ^“j1**3*  dx  *  r  expt- jb(nT) *V* ] 1 2  cos(b(mAy)*)reet[mAy/Y]  •  6(m-r 


«  5  [  Ja  e~j2"ust  dx  ]  2rcostb(nAy) * J  cos(b( (m-n) Ay ) * )  recti ( (m-n)Ay) /y] 
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Fig.  9.  Crossectione  through  coarse 
frequency  ridge  for  the  folded  spectrum 
processor  of  Fig.  •  for  fine  frequencies 
a)  loo  Hz  b)  looo  Hz  c)  2000  Hz  d)  sooo  Hz. 


Fig.  10.  Impulse  response  of  TSI  folded 
spectrum  processor  displayed  in  a  2-D 
format  on  a  video  monitor,  a)  60.000  MHz 
b)  60.001  MHz  C)  30.000  MHz  d)  30.001  MHz. 
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Nt  can  aae  that  the  quadratical ly  phase  aodulated  reference  beam  results  in  an 
}  interferometric  premultiplication  of  each  sampled  baseband  coarse  frequency  bin  with  a 

,  temporal  chirp.  The  combination  of  the  chirp  mask  and  the  TO I  CCD  results  in  a  chirp 

<  convolution  for  each  coarse  frequency  channel,  and  the  resulting  folded  spectrum  raster 

<  scans  out  of  the  CCD  as  it  scrolls.  Experimental  results  from  this  processor  are  shown  in 

I  Fig.  •  and  Fig.  10.  Figures  9a-d  show  crossections  through  the  coarse  frequency  ridge  of 

the  Impulse  response  of  Fig.  t  for  several  input  fine  frequencies,  and  the  decrease  of 
*  peak  heigth  with  increasing  frequency  is  apparent.  Figure  10  shows  the  2-D  Folded  Spectrum 

£  output  displayed  on  a  video  monitor  for  a  variety  of  input  frequencies,  where  the  coarse 

,  ridge  is  seen  to  move  with  10  MBz  frequency  change,  and  1  KHz  moves  the  fringes  in  the 

fine  dimension  along  the  ridge.  The  spatial  and  temporal  chirp  references  used  in  these 
^  experiments  were  two  sided  with  9  fringes  per  side  giving  a  compression  of  sc.  and 

j  resulting  in  a  spectrum  analysis  with  SC  Independently  resolvable  frequencies.  The 

I  sideband  structure  is  highly  visible  due  to  the  hard  clipping  of  the  mask,  both  the 

,«  spectral  resolution  and  the  linearity  are  better  than  100  Hz.  and  the  performance  closely 

matches  the  expected  theoretical  behavior. 
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Demodulation  at  Signal  From  Bias  Terms 

A  crucial  requirement  for  the  successful  operation  of  a  TSI  signal  processing  system 
is  the  ability  to  demodulate  the  signal  from  the  bias  terms.  There  are  two  main  approaches 
to  signal  demodulation  which  are  shown  in  Fig.  11.  spatial  carrier  demodulation  and  CCD 
based  demodulation.  In  carrier  demodulation  the  Interferometric  signal  term  is  placed  on  a 
spatial  carrier  by  the  adjustment  of  the  reference  beam  incidence  angle,  while  the  bias 
terms  remain  at  baseband.  When  these  signals  are  output  from  the  CCD.  a  bandpass  filter 
can  separate  the  different  components,  and  allow  measurement  of  spectral  amplitude  and 
phase.  The  filtered  output  can  be  electronically  squared  and  low  passed  in  order  to  obtain 
a  power  spectrum,  or  rectification  followed  by  a  low  pass  can  be  used  for  measuring 
spectral  amplitude  components.  The  CCD  raBter  readout  mechanism  can  be  used  to  change  a 
spatial  carrier  in  the  horizontal  direction  into  a  fast  temporal  carrier  that  can  be 
simply  bandpassed  by  an  active  filter.  A  spatial  carrier  in  the  vertical  dimension 
requires  a  more  complicated  set  of  video  delay  lines  and  a  tapped  filter  in  order  to 
implement  the  desired  bandpass  operation.  The  spatial  carrier  can  be  placed  in  the  coarse 
or  fine  frequency  directions,  but  will  cut  down  the  available  CCD  space  bandwidth  product 
in  whichever  dimension  it  is  used.  In  order  to  avoid  losing  detector  resolution,  another 
possible  approach  is  to  have  two  syncronously  operating  CCD  detectors,  one  to  detect  the 
interferometric  signal  and  bias  terms,  and  the  other  with  just  the  signal  term  in  order  to 
detect  the  signal  dependent  bias.  The  two  detectors  must  be  precisely  aligned  and 
subtracted  pixel  by  pixel  in  order  to  remove  the  signal  dependent  bias,  the  reference  beam 
bias  term  should  be  uniform  across  the  array  and  can  be  subtracted  with  a  level  shifter. 
An  experimental  biaB  subtraction  technique  we  are  investigating  requires  a  special  purpose 
CCD  with  a  Fill  and  Spill  structure  abutted  to  the  transfer  register  in  order  to  bleed  off 
an  appropriate  amount  of  charge  to  leave  the  signal  term  and  a  small  amount  of  bias, 
rather  than  have  the  biaB  use  up  the  available  CCD  dynamic  range. 


&Q  Folded  Spectrum  Processor  Perforimce 
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A  summary  of  the  performance  parameters  for  the  TSI  folded  spectrum  processor 
described  in  this  paper  are  given  in  Fig.  12,  for  the  Caltech  prototype,  and  for  the 
potential  of  a  fully  engineered  state  of  the  art  brassboard.  The  processor  analysis 
bandwidth  is  determined  by  the  AOD  bandwidth,  the  CCD  width  and  Fourier  lens  focal  length, 
and  by  the  laser  diode  pulse  width  at  an  acceptable  level  of  illumination  and  temporal 
coherence.  The  Caltech  prototype  was  limited  by  the  CCD  width,  which  can  easily  be 
modified.  The  minimum  laser  diode  pulse  width  is  determined  by  the  multimode  transient 
operation  for  the  first  1  nsec  which  results  in  incoherent  operation  inappropriate  for 
this  processor11,  however  light  limitations  will  also  dictate  a  minimum  pulse  width 
determined  by  peak  output  power.  The  number  of  coarse  frequency  bins  is  determined 
primarily  by  the  number  of  CCD  pixels,  but  another  limitation  is  due  to  the  AOD  time 
bandwidth  product  and  apodizatlon  uniformity.  The  availability  of  the  Tektronix  2000x2000 
CCD  is  very  encouraging  for  the  development  of  optical  processors  requiring  high 
resolution  2-D  detectors.  The  coarse  frequency  resolution  is  limited  by  the  AOD-  transit 
time  and  apodizatlon.  but  also  determined  by  the  FT  lens  focal  length  and  pixel  width. 
The  number  of  fine  frequency  resolution  bins  is  determined  by  the  space  bandwidth  of  the 
reference  functions  and  the  number  of  CCD  pixels  available.  If  a  spatial  carrier  is 
Included  in  the  fine  frequency  dimension,  then  the  number  of  fine  resolution  bins  is 
further  limited  ,  and  a  maximum  spatial  carrier  frequency  of  4-t  pixels  per  cycle 
indicates  that  a  maximum  of  500  fine  frequency  bins  could  be  predicted.  The  fine 
resolution  is  fundamentally  limited  by  the  CCD  Integration  time  during  which  the  LD  is 
being  pulsed  and  the  prototype  processor  has  closely  epproached  this  limit.  Actually  a 
greater  difficulty  is  encountered  in  attempting  to  achieve  a  fine  frequency  analysis 
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bandwidth  equal  to  the  coarse  frequency  resolution,  which  requires  high  bandwidth 
electronic  reference  generation  curently  not  obtainable  with  our  prototype  circuitry.  The 
nil  chirp  transfora  approach  is  Halted  in  analysis  bandwidth  by  the  mask  resolution  and 
by  the  obtainable  CCD  shift  rate,  which  is  currently  Halted  to  is  KBz  for  video 
coapattible  devices,  but  could  be  increased  with  special  CCD  circuitry.  The  total  number 
of  Independent  spectral  aeaaureaenta  that  are  being  aade  in  our  initial  experiments  was 
only  IS. 000  but  a  potential  for  on  the  order  of  10s  clearly  exists.  The  dynamic  range  is 
currently  quite  small  due  to  coherence  limitations  and  light  starvation,  but  this  will  be 
greatly  improved  in  the  next  generation  processor.  The  most  important  perforaance 
parameter  for  the  SETI  search  is  the  sensitivity  to  a  signal  hurried  in  noise,  and  the 
processing  gain  limitations  of  the  analog  technique  used  to  perform  the  spectral  analysis. 
The  large  AOD  dynamic  range  allows  very  weak  signals  to  be  effectively  transduced  into  the 
optical  processor,  but  a  huge  CCD  dynamic  range  is  not  required  to  achieve  the  desired 
processing  gain,  since  the  spatial  integration  achieves  auch  of  it. 

Since  sensitivity  and  processing  gain  are  so  important  to  the  SETI  application  we 
will  Include  a  simple  analysis  of  the  processor  limitations  based  on  the  modelt  presented 
in  Pig.  13.  for  a  weak  narrowband  CW  input  buried  in  white  noise  with  power  «n  we  will 
have  a  system  input 


s(t)  -  a  e^#t  «•  n(t).  (21) 


The  amplifier  and  AOD  have  a  large  linear  region  and  a  saturation  regime  that  will 
introduce  third  order  interaodulation  products  that  will  degrade  syBtem  performance.  An 
ideal  gain  G  is  included  due  to  an  optical  power  increase  which  will  not  increase  the 
relative  power  in  the  interaodulation  terms.  The  processor  consists  of  a  SI  coarse 
frequency  channellzer  which  acts  as  10  band  pass  filters  (BPF).,  cascaded  onto  an  array  of 
10  TI  spectrum  analyzers,  resulting  in  the  synthesis  of  10  narrowband  filters.  The 
detected  spectral  amplitudes  are  corrupted  by  the  inclusion  of  signal  dependtnt  noise,  and 
the  detector  noise  term  with  variance  e^.  The  processing  gain  is  defined  as  the  ratio  of 
input  signal  to  noise  ratio  (SNR)  to  output  SNR,  and  ideally  it  would  be  given  by 
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(22) 


Where  p  is  the  BPF  width  divided  by  the  entire  bandwidth,  which  is  equivalently  the 
inverse  of  the  number  of  channels.  After  the  demodulation  operation,  which  will  remove  the 
bias  terms  and  including  the  bias  shot  noise  contribution  in  oj.  the  expected  value  of  the 
power  spectum  component  at  the  frequency  of  the  input  tone  will  be 
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.(23) 


The  input  sensitivity  is  determined  by  the  minimum  detectab^  tiqppl  at  the  desired  false 
alarm  probability,  which  for  SETI  iB  on  the  order  of  10"  -e"  .  in  order  to  keep  the 
total  number  of  false  alarms  manageable.  By  cross  scanning  the  sky  and  comparing  positions 
and  frequencies  of  spectral  components  exceeding  the  given  threshold,  the  false  alarm 
probability  can  easily  ^  squared.  Thus  the  minimum  detectable  signal  resulting  in  a  false 
alarm  probability  of  e~  would  be  10  standard  deviations  above  the  noi6e. 

•iinG*  >  io[p*G%**«d]  ,24) 


To  minimize  effect  of  the  detector  noise  limitations  we  increase  the  gain  G  to  the  point 
that  the  signal  dependent  noise  and  the  detector  noise  are  comparable.  In  thi6  case 
minimum  input  SNR  that  can  result  in  a  signal  exceeding  the  threshold  is  given  by 


SNRmin  *  Hin'-n  *  lOU^a/cS;!  -  20P* 


Thus  the  resulting  input  sensitivity  is  degraded  by  13dB  from  the  initial  -*0dB.  but  only 
IdB  of  the  degradation  is  an  artifact  of  the  analog  optical  processor.  This  estimate  for 
the  actual  input  sensitivity  of  -47dB  will  be  further  degraded  by  the  intermodulation 
product  terms  due  to  the  amplifier  and  AOD  nonlinearities,  by  the  shot  noise  due  to  the 
bias,  and  probably  most  importantly  by  light  starvation  limiting  the  gain  G. 


Conclnalon 


Zn  this  paper  we  have  have  presented  preliminary  experimental  reaulta  from  time  and 
apace  Integrating  folded  epectrum  processors  that  may  have  potential  application  in  the 
6ETI  program.  The  aampling  action  of  the  repetitively  pulaed  laser  diode  eliminates  the 
need  for  a  distributed  local  oscillator  reference  vave-by  aliasing  all  of  the  fine 
frequency  components  to  baseband  at  the  output  of  the  coarse  frequency  channelizing  apace 
integrating  spectrum  analyzer  as  is  required  for  the  following  CCD  baaed  narrow  band  time 
integrating  spectrum  analyzers.  Two  methods  of  time  integrating  fine  frequency  analysis 
were  presented,  the  time  integrating  DFT,  and  the  time  delay  and  integrate  chirp 
transform.  The  TI  DPT  has  the  attractive  possibility  for  incoherent  addition  of  spectra  in 
order  to  improve  SNR.  but  requires  a  very  complex  and  accurate  reference  waveform.  The  TD1 
chirp  transform  helps  average  out  coherent  noise  and  detector  noise,  and  has  a  simple 
reference  function,  but  does  not  allow  simple  complex  spectral  demodulation,  and  is 
bandwidth  limited  by  the  available  CCD  shift  rate.  The  possible  advantages  of  this 
technique  over  alternative  digital  approaches,  are  a  decrease  in  system  cost  and 
complexity,  along  with  the  elimination  of  the  high  speed  analog  to  digital  converter 
required  for  digital  processing.  For  a  possible  future  spaceborne  SETI  search  the  optical 
processor  haB  decreased  size,  weight  and  power  requirements  over  that  of  a  digital 
approach. 
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Fig,  12.  TS1  AO  processor  performance  for 
Caltech  prototype  and  predicted  state  of 
the  art  brassboard  processor. 
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Fig.  1J.  Model  used  for  sensitivity  and 
processing  gain  analysis. 


r  f 

<*.v 

•'.V 


v'v.v) 

't 

4N  m\ 
'  a'*  AO 

vt:m 

-v;v 

V  \.\-\ 
i ;  y.V 


•VC'v 


raF  jr 

/>Vvv  -v 


|i pi. pij niyitfV HJl  JJ  JJTgFU"7" H1  J.1  V  i.M. 1  ». I WJ WWIH1.1* l'< 'IMM  1 " > ' n  '  ■  >  l ‘Ji ■  l H » . ■ 


-"W.  v  nr.  nr1  v. 


I 


I 


v. 


* 


s. 


j. 


352-19 


Real  Time  Computation  of  Moments  with  Acousto-optics 
Xelvin  Wagner  and  Demetri  Psaltis 


Department  of  Electrical  Engineering 
California  Institute  of  Technology 
Pasadena,  CA  91125 


Abstract 


The  separable  nature  of  the  geometric  moment  generating  functions  and  the  serial  raster 
encoding  of  the  image  permits  the  2-dimensional  moment  integral  equation  to  be  computed  with 
a  cascaded  system  of  1-dimensional  integrations.  In  this  paper  new  optical  processing 
architectures  are  presented  that  use  acousto-optic  devices  illuminated  by  pulsed  sources  to 
enter  the  data  into  the  optical  system.  The  advanced  state  of  the  art  of  the  components 
used  and  the  flexibility  of  these  architectures  can  lead  to  the  implementation  of  practical 
optical  processing  system  for  computing  the  moments  of  a  real  time  high  resolution  image. 


Introduction 


Given  a  finite  image  intensity  distribution  f(x,y)  over  an  aperture  A,  the  p,qth 


geometric  moment  m^  of  order  p+q  is  given  by  the  moment  integral  equation 


(1) 


m «  fj  xp  yq  f  (x,y)  dxdy. 

Pq  A 

The  value  of  these  geometric  moments  are  sensitive  to  the  position,  scale,  rotation  and 
contrast  of  the  image.  Appropriate  nonlinear  combinations  of  moments  can  be  made  invariant 
intraclass  variations.  1,2,j,5,o,8  mw-.-  m^rnanf  i  anf  e  mav  hatra 


to  all  of  these  intraclass  variations.  These  moment  invariants  may  have 

applications  in  pattern  recognition  as  a  low  dimensionality  feature  space  for  image  classi¬ 
fication4  and  in  coding  the  essential  features  of  an  image8.  Alternatively  the  moments  can 
be  used  to  normalize  an  image7  so  that  intraclass  variations  are  minimized,  so  that  standard 
pattern  recognition  techniques  such  as  template  matching  can  be  applied  successfully.  The 
zeroth  order  moment  gives  £he  average  of  f(x,y).  The  first  order  moments  locate  the  image 
centroid  x  *  mlo/mQo ,  y  ■  "ol/moo.  The  central  moments  y  are  defined  with  the  centroid  as 

the  origin  and  are  invariant  to  translations  of  the  image 


pq 


//(x-i)p  (y-y)**  f  (x,y)  dxdy 
A 


P 

l 

r*o 


(?)  0 


<-x) 


p-r 


(-y)q_s 


(2) 


Rotation  and  scale  invariant  moments  of  order  (p,q)  can  be  defined  in  terms  of  the  ordinary 
moments  m _ . 


9-12 

Coherent  optical  processors  have  been  proposed  to  compute  the  moments  ,  using  2- 


dimensional  spatial  light  modulators  (SLM)  for  real  time  operation.  The  separable  nature 
of  the  geometric  moment  generating  functions  and  serial  raster  encoding  of  the  image  allows 
the  decomposition  of  the  moment  integral  into  cascaded  1-dimensional  integrations.  New 
architectures  are  presented  that  use  1-dimensional  acousto-optic  (AOD)  spatial  light  modu¬ 
lators  to  enter  the  data  into  the  optical  system.  In  the  first  architecture  the  separable 
moment  generating  functions  are  entered  through  the  AOD's,  which  allows  flexibility  in  the 
choice  of  generating  functions,  and  accuracy  of  their  representation.  Alternatively  the 
moment  generating  functions  can  be  written  on  film  or  used  to  modulate  the  optical  source 
and  the  raster  recorded  image  is  entered  into  the  optical  system  through  the  AOD.  .The  large 
dynamic  range  and  rapid  programmability  of  acousto-optic  devices  can  allow  the  implementa¬ 
tion  of  practical  real  time  optical  computers  for  the  generation  of  the  geometric  moments  of 
an  image. 


Space  Integrating  Processor 

Film  based  coherent  optical  processors  have  been  proposed  9-12  for  computing  the 


geometric  moments  of  an  image  using  the  2-D  spatial  integration  performed  by  a  spherical 
Fourier  transform  (FT)  lens.  Teague's’  method  requires  multiple  differentiation  of  the  ! 
of  the  image.  The  other  methods  10,12 


involve  the  spatial  integration  of  the  product  of  the 
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image  f(x,y)  and  the  moment  generating  function  g  (x,y)  -  xp  y9.  Spatial  frequency 
multiplexing  of  the  generating  functions  in  a  computer  generated  hologram  can  be  used  to 
compute  all  the  desired  moments  in  parallel  at  separate  locations  in  the  frequency  plane. 

Since  the  geometric  moment  generating  function  xp  y9  is  separable  in  cartesian 
coordinates,  we  can  replace  the  moment  mash  of  Ref.  10,11  with  a  pair  of  crossed  acousto¬ 
optic  deflectors  (AOO)  schlieren  imaged  onto  the  image  film  as  shown  in  Fig.  1.  This  i 
similar  to  a  triple  product  processor  architecture! ? f  except  that  the  continuously  modulated 
source  is  now  pulsed.  If  the  pulse  width  is  less  than  the  inverse  bandwidth  of  the  signals 
in  the  AOOs,  then  it  will  act  as  a  delta  function  in  time  and  freeze  the  image  of  the 
moment  generating  function  when  it  illuminates  the  input  image.  The  functions  tp  and  t9 
are  synchronously  applied  to  the  AODs  as  amplitude  modulations  to  an  RF  carrier  at  the 
center  frequency  of  the  AOD 

_  if  t 

Sip  (t)  -  tp  e  3 

_  -i2  "ft 

S2q  (t)  *  tq  e  3  °  .  (3) 

For  odd  powers  there  is  a  charge  of  sign  at  t«o  that  is  represented  with  a  180°  phase 
change.  This  will  lead  to  destructive  interference  at  the  integrated  output  which  can  be 
interferometrically  detected.  When  these  signals  simultaneously  slide  to  the  centers  of 
the  AODs  the  laser  diode  (LD)  is  pulsed,  collimated,  and  focused  into  a  horizontal  strip 
that  enters  AOD1  at  the  Bragg  angle.  The  diffracted  light  is  collimated  in  y  and  Fourier 
transformed  in  x  to  produce  a  vertical  strip  that  illuminates  AOD2  at  its  Bragg  angle.  Both 
undiffracted  components  are  filtered,  and  the  doubly  diffracted  light  is  expanded  in  x  to 
a  square  so  that  AOD1  is  imaged  onto  f(x,y)  in  the  -x  direction  and  AOD2  is  imaged  onto 
f(x,y)  in  the  -y  direction.  The  light  amplitude  incident  on  the  image  is  similar  to  an 
outer  product  and  is  modulated  by 

Ei  (x,y,t)  =  6  (t)  Slp  (x+vt)  S2<J  (y+vt) 

-  6<t)  Slp  (x)  S2q(y).  (4) 

This  is  multiplied  by  the  image  transmittivity ,  f(x,y),  and  the  product  is  Fourier  trans¬ 
formed  by  the  integrating  lens.  This  transform  can  be  sampled  at  its  center  or  integrated 
over  its  whole  extent  to  yield  an  interferometrically  detected  signal  proportional  to  the 
desired  moment. 


.//slp(x>  S2g(y)  f  (x,y)  dxdy  -  JJ  XP  yq  f(x,y)  dxdy. 


All  the  desired  moments  could  be  computed  successively  with  high  accuracy  and  dynamic  range 
on  a  single  detector  pair  very  rapidly.  For  an  AOD  with  a  lOusec  aperture  time  moments 
through  the  tenth  order  could  be  computed  in  .5msec.  This  would  allow  many  differently 
windowed  sets  of  moments  to  be  computed  during  each  frame  time  of  available  2-D  spatial 
light  modulators.  Alternatively  the  moments  could  be  computed  simultaneously  with  lower 
dynamic  range  in  a  few  microseconds  by  using  temporal  frequency  multiplexing  of  the  moment 
generating  functions.  This  is  shown  in  Figure  2.  In  this  case  the  following  signals  are 
applied  to  the  two  AOD's  of  the  system. 


(t) 


S2  (t) 


tp  e  j2" <f0+pif)t 


,  j2n  (fo+q&f)t 


where  Af  is  the  frequency  separation  of  the  frequency  multiplexed  moment  generating  fuctions. 
For  an  image  bandwidth  B  [cy/mm]  and  acoustic  velocity  v,  the  different  moments  would  be 
spatially  separated  in  the  output  plane  if  Af/v>  B,  and  therefore  could  be  sampled  by  an 
appropriately  arranged  array  of  detectors. 

The  versatility  of  this  system  allows  the  direct  optical  computation  of  the  central 
moments  u  _  instead  of  the  geometric  moments  m  .  First  the  centroid  is  located  in  each 

P9  P9  -  m 

dimension  separately  by  finding  the  oth  and  1st  order  moments  and  using  x  «  lo/m  , 
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y  “  or  by  operating  the  source  CW,  and  locating  the  2ero  crossing  of  the  detector's 

OX  oo 

temporal  output  as  the  generating  functions  for  or  slide  through  the  Bragg  cells. 

To  compute  the  central  moments  directly  the  moment  generating  functions  are  input  to  AODl 
and  A0D2  with  a  relative  delay  T,j  "  Ti  ~  x2  ”  x/v  ”  ?/v  an<^  the  LD  Pul8e<*  *t  t«T^.  This 

aligns  the  origin  of  the  moment  generating  functions  with  the  image  centroid,  and  the 
spatially  integrated  outputs  compute  the  central  moments  y^.  This  architecture  also 
allows  the  windowing  of  the  region  for  which  the  moments  are  being  computed  by  simply 

windowing  the  electronic  signals  S,  (t)  and  S2<t),  this  would  allow  a  rapid  search  for  the 
appropriate  window  within  f(x,y)  to  be  made  under  computer  control. 


Space  and  Time  Integrating  Architecture 


The  performance  of  the  space  integrating  moment  processor  could  be  limited  by  the  2-D 
spatial  light  modulator  (SLM)  required  for  real  time  operation.  In  many  applications  the 
image  is  available  to  the  optical  processor  in  the  form  of  a  serial  raster  signal.  In  this 
case,  the  2-D  image  f(x,y)  can  be  entered  into  the  optical  processor  one  line  at  a  time 
through  a  1-D  SLM  such  as  an  acousto-optic  device  (AOD)  13,14 ^  The  raster  scanned  repre¬ 
sentation  of  a  continuous  image  f(x,y)  is  denoted  by  f(x,nAy)  where  n  is  an  integer  and  Ay 
is  the  separation  between  the  raster  lines.  The  moments  can  be  calculated  from  the  sampled 
image  by  replacing  the  integration  over  y  in  Eq.  (1)  with  a  summation  over  n 


■Vj 


n  f 

Z  (nAy)qJ  xp  f(x,nAy)  dx. 
n«l 


(7) 


This  formation  suggest  a  hybird  space  and  time  integrating  system*  ’  '  as  shown  in  Fig. 

3.  The  video  raster  lines  are  sequentially  applied  to  an  AOD  operated  in  the  intensity 
modulation  regime  and  oriented  in  the  x  direction,  as  an  amplitude  modulation  of  an  RF 
carrier  at  the  center  frequency  of  the  piezoelectric  transducer.  The  AOD  is  illuminated  by 
the  collimated  light  emitted  from  a  closely  spaced  array  of  Q+l  pulsed  modulated  laser 
diodes  (LD) .  If  all  the  LD's  emit  light  at  the  same  wavelength  then  the  spatial  frequency 
multiplexed  light  incident  on  the  AOD  must  be  within  its  Bragg  angular  aperture.  Alterna¬ 
tively,  the  momentum  mismatch  can  be  compensated  by  varying  the  wavelength  in  the  LD  array, 
so  that  the  light  from  each  LD  is  incident  on  the  AOD  at  the  Bragg  angle  for  that  wavelength, 
when  the  nth  video  raster  line  completely  fills  the  AOD  aperture,  the  entire  LD  array  is 
synchronously  pulsed  with  a  pulse  width  short  enough  to  freeze  the  image  of  the  raster  line 
within  the  AOD.  The  intensity  modulation  of  the  qth  LD  is  given  by 


I  (t)  -  Z  (nq  +  bias)  6(t  -  nT) , 


where  T  is  the  video  line  time  and  the  bias  may  be  needed  to  represent  the  bipolar  odd 
moment  generating  functions.  The  bias  is  not  necessary  for  the  even  moments  and  spatial 
multiplexing  can  be  used  rather  than  bias  to  represent . the  bipolar  odd  moments.  The  light 
diffracted  by  the  AOD  is  expanded  and  collimated  in  y  and  schlieren  imaged  in  x,  so  the 
intensity  incident  on  P3  from  the  qth  LD  during  the  nth  raster  line  is 

03(x,t)  «  Iq(t)  f(t-  £,  nAy)  -  nq  5<t-nT)  t nAy) .  (9) 

At  plane  P3  a  mask  is  placed  containing  the  intensity  transmittance  variations  xp  at 
different  y  coordinates: 

t (x,y)  «  I  xP  rect  fy~py01  (10) 

P-o  L  ye  J  * 

The  light  leaving  Pj  (modulated  by  the  product  of  the  incident  intensity  and  the  mask  trans¬ 
mittance),  is  then  imaged  in  the  y  dimension  and  integrated  in  the  x  direction  onto  the  plane 
P^  .  At  the  output  plane  there  are  (Q+l)  columns  of  (P+1)  detectors  each.  Each  LD,  is 
imaged  onto  a  separate  column  and  to  avoid  crosstalk  the  columns  must  be  separated  by 
A>XFv/B,  where  F  is  the  focal  length  of  the  integrating  lens,  v  is  the  acoustic  velocity  and 
B  is  the  video  bandwidth.  If  the  detector  is  wide  enough  to  collect  all  the  light  from  its 
associated  laser  diode  then  the  detected  signal  on  the  p,qth  detector  during  the  nth  pulse 
will  be  proportional  to 
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Spq(n)  ’  J<n+^>T  Ig(t)  J  03(x,t)  xp  dx  dt  -  rPju*'  nAy)  XP  dx. 
J  (n-j)T 


(11) 


If  the  detector  is  time  integrated  for  a  full  video  frame  the  output  of  the  p,qth  detector 
becomes 

.NT 

,P 


pq 


|  Iq(t)  J  03(x,t)  x*"  dx  dt 

I  nq  f  f (£,  niy)  xp  dx 

an  J  V 


o 

N 

r 

n*o 


I  Jnq  xp  f  (£,  niy)  dx, 
n*o  J 


(12) 


which  is  proportional  to  the  desired  moment  calculation.  All 
computed  in  parallel  on  a  2-dimensional  array  of  detectors. 


(P+1)  x  (Q+l)  moments  are 


An  alternative  topology  of  the  optical  processor  is  obtained  by  spatially  multiplexing 
the  LDs  in  the  y  direction  as  shown  in  Fig.  4.  This  elliminates  the  problem  of  Bragg  angle 
mismatch  previously  encountered,  and  allows  all  the  moments  to  be  detected  on  a  single 
linear  detector  array,  without  crosstalk.  The  mask  must  be  repeated  once  for  each  laser 
diode  for  this  architecture  and  its  intensity  transmittance  is  given  by 


t  (x,y) 


Q 

I 

q=o 


P 

E 

p=o 


rect 


fy-q  (p+i )  y0_py, 


‘1 


(13) 


Another  useful  feature  of  this  architecute  is  its  extension  to  bipolar  processing  as  shown 
in  Fig.  5.  For  odd  q  two  laser  diodes  can  be  spatially  multiplexed  in  the  x  direction,  one 
represents  the  positive  and  the  other  the  negative  portions  of  the  moment  generating 
function.  Similarly  for  odd  p  two  rows  of  the  mask  are  used  to  represent  the  positive  and 
negative  portions  of  this  half  of  the  moment  generating  function.  Two  linear  time  integra¬ 
ting  detector  arrays  are  used  to  detect  the  four  cross  products.  The  outputs  are  electron¬ 
ically  added  and  subtracted  to  yield  the  calculated  bipolar  moment. 

Discussion 


In  optical  analog  computers  of  this  type  errors  and  noise  can  enter  into  the  calcula¬ 
tion  for  many  reasons.  These  include  noise  in  the  modulated  laser  diode  sources,  non- 
linearities  in  the  acousto-optic  Bragg  cell,  quantization  errors  and  film  nonlinearities  of 
the  computer  generated  masks,  optical  aberrations,  coherent  noise  and  detector  noise. 

Careful  optical  and  electronic  design  can  minimize  most  of  these  effects,  and  in  practice 
the  output  detector  array  is  a  major  factor  that  limits  the  accuracy  of  an  optical  computer. 
Typical  charge  coupled  device  (CCD)  detector  arrays  have  an  output  SNR  of  1000:1,  which 
allows  a  digitization  of  the  optically  computed  geometric  moments  to  a  resolution  of  10  bits. 
A  digital  post  processor  can  then  combine  the  geometrical  moments  to  produce  the  invariants 
and  perform  a  pattern  classification  based  on  the  invariant  feature  space.  The  geometrical 
moment  optical  preprocessor  takes  the  bulk  of  the  computational  load  away  from  the  digital 
computer,  however  some  accuracy  is  sacrificed. 

The  separable  moment  generating  function  *  p  is  positive  definite  for  even  powers  p, 
and  an  incoherent  unipolar  intensity  representation  can  be  used.  For  odd  powers  p,  the 
moment  generating  functions  become  bipolar.  Therefore  the  capability  to  represent  bipolar 
quantities  must  be  incorporated  in  the  optical  processor.  If  coherent  light  is  used  the 
cancellation  needed  for  odd  moment  powers  can  be  performed  in  the  space  integrating 
processors  by  destructive  interference  and  interferometric  detection.  However  in  the  time 
integrating  architectures  the  processing  is  performed  by  integrating  photogenerated  charge 
on  the  detector,  which  is  proportional  to  the  number  of  incident  photons  or  the  intensity 
and  therefore  strictly  positive.  Bipolar  operations  can  be  performed  by  placing  the  odd 
moment  generating  functions  on  a  bias.  This  in  turn  places  a  bias  on  the  detector  thereby 
decreasing  the  available  dynamic  range  of  the  computed  moments.  Alternatively  the  positive 
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and  negative  halves  of  the  separable  odd  moment  generating  functions  can  be  represented 
in  separate  channels  of  the  processor.  The  crossproduct  terms  must  be  electronically 
combined  with  the  appropriate  sign  when  the  detector  is  read  out  in  order  to  produce  an 
estimate  of  the  bipolar  moment.  The  achievable  accuracy  and  dynamic  range  of  this  bipolar 
estimate  will  be  limited  by  the  requirement  that  none  of  the  detectors  saturate,  and  that 
the  variances  of  the  noise  will  add.  The  possibility  of  a  special  purpose  directly  coupled 
detector  structures  to  perform  the  continuous  subtraction  needed  for  incoherent  bipolar 
optical  processing  merits  further  research. 

Conclusions 

In  conclusion  we  have  proposed  several  optical  computing  architectures  for  calculating 
the  geometrical  moments  of  images  in  real  time.  The  space  integrating  processor  requires 
a  2-D  SLM  to  represent  the  image,  but  has  the  flexibility  of  electronic  control  of  the 
separable  moment  generating  function.  With  this  processor  the  moments  can  be  calculated 
sequentially  at  a  rapid  rate  with  high  accuracy.  The  time  and  space  integrating  architec¬ 
tures  are  not  as  flexible  since  the  moment  generating  functions  are  fixed  by  the  computer 
generated  masks.  However  since  acousto-optic  devices  are  used  to  enter  the  raster  video 
data  into  the  optical  processing  system,  the  need  for  a  real  time  2-D  SLM  is  avoided. 
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Figure  1 .  Space  integrating  geometric 

moment  processor  with  crossed 
Bragg  cells  to  enter  the 
separable  moment  generating 
function. 
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Figure  3a.  Time  and  space  integrating 

moment  processor  with  horizontal 
spatial  multiplexing  of  modulated 
pulsed  laser  diodes  and  acousto¬ 
optic  entry  of  video  raster  data. 


figure  2.  Frequency  multiplexed 

space  integrating  architecture. 
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Figure  3b.  Top  view  and  operation  of 
the  processor. 
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Figure  4.  Time  and  space  integrating  moment  processor 
with  vertical  spatial  multiplexing  of  the 
laser  diode  array. 


Figure  5.  Bipolar  representation  of  the  odd  moment 

generating  function  in  the  processor  of  Figure  4,’ 
by  horizontal  multiplexing  of  the  sources  and 
vertical  multiplexing  in  the  mask. 
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An  optical  architecture  is  described  for  performing  pipelined  matrix-matrix  multiplications.  The  architecture  is  imple¬ 
mented  using  multiple  transducer  acousto-optic  devices  and  a  wideband  photodetector  array.  A  variant  of  engagement  for¬ 
matting  allows  multiple  inner  products  to  be  simultaneously  computed  by  1  -D  spatial  integration,  and  through  proper  pipe¬ 
lining  the  full  product  matrix  is  produced  at  the  output  of  the  detector  array.  The  output  matrix  in  this  architecture  is  in  a 
format  that  is  directly  compatible  with  the  input,  a  feature  that  can  facilitate  the  implementation  of  iterative  matrix  algo¬ 
rithms.  Digital  multiplication  by  analog  convolution  can  be  incorporated  for  improved  accuracy  by  using  a  frequency  multi 
plexed  representation  of  the  binary  data. 


1 .  Introduction 

The  optical  implementation  of  matrix  operations 
has  received  considerable  attention  recently.  Architec¬ 
tures  and  algorithms  have  been  designed  that  have  in¬ 
creased  the  speed,  accuracy  and  flexibility  of  optical 
matrix  processors,  extending  the  potential  applicabili¬ 
ty  of  such  systems  to  a  broader  range  of  problems. 
Specific  advances  that  have  been  accomplished  in  re¬ 
cent  years  include  the  initial  demonstration  of  vector- 
matrix  multiplication  [1 J,  the  introduction  of  time  in¬ 
tegrating  systolic  [2], engagement  (3,4],  and  outer 
product  optical  processors  (5],  a  frequency  multi¬ 
plexed  processor  (6],  improvements  in  accuracy  with 
residue  arithmetic  (7],  the  utilization  of  the  method 
of  digital  multiplication  by  analog  convolution  (DMAC) 
(8,9]  in  the  above  array  processors  [10, 11],  and  a 
combination  of  systolic  processing  and  the  DMAC  al¬ 
gorithm  in  a  two  dimensional  implementation  utilizing 
crossed  multichannel  Brag  cells  for  matrix  vector  mul¬ 
tiplications  with  digital  accuracy  (12). 

Perhaps  the  most  significant  application  of  numeri¬ 
cal  optical  processors  is  in  0{N3)  problems,  i.e.  ma¬ 
trix  algebra  problems  that  require  a  minimum  of  A3 
multiplications  and  additions,  where  N  is  the  size  of 
the  matrix  involved.  The  solution  of  a  set  of  linear 
equations,  matrix  inversion,  and  singular  value  decom- 
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position  are  examples  of  such  problems  [13].  Optical 
techniques  can  be  applied  to  such  problems  by  select¬ 
ing  an  algorithm  that  can  implement  the  required 
operation  with  successive  matrix -matrix  multiplica¬ 
tions,  such  as  Gauss  eliminations,  Givens  transforma¬ 
tions  or  Housholder  reflections  [13].  For  these  algo¬ 
rithms  /V  optical  matrix  multiplications  are  required, 
and  since  each  matrix-matrix  multiplication  requires 
A3  multiplies  and  adds,  optical  systems  usually  solve 
an  A3  problem  with  A'4  operations.  However,  the 
speed  and  parallelism  of  optics  can  make  the  optical 
implementation  advantageous,  despite  this  inefficiency. 
The  product  matrix  that  is  produced  at  each  iteration 
during  the  execution  of  such  an  algorithm  is  used  as 
one  of  the  input  matrices  for  the  next  iteration.  It  is 
therefore  important  that  the  format  of  the  output 
product  matrix  is  directly  compatible  with  the  input 
in  order  to  avoid  reformatting  and  minimize  the  itera¬ 
tion  time.  The  architecture  described  in  this  paper  was 
selected  principally  because  the  output  can  be  ampli¬ 
fied  and  applied  directly  to  the  input.  A  space  inte¬ 
grating  implementation  using  a  parellel  output  wide¬ 
band  photodetector  array  is  chosen  for  accuracy  and 
speed  considerations.  Several  candidate  data  flow  opti¬ 
cal  architectures  satisfying  these  requirements  are  pos¬ 
sible.  In  this  paper  we  present  one  such  data  flow  ma¬ 
trix  proc  jsor  which  uses  crossed  multichannel  acousto- 
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optic  devices  (AOD).  The  operation  of  the  system  is 
based  on  time  and  space  alignment  of  vectors  which 
allows  the  formation  of  multiple  inner  product  sum¬ 
mations  via  spatial  integration  in  a  pipelined  fashion. 
The  matrix  format  is  similar  to  an  engagement  array, 
but  the  data  flow  is  transposed  so  that  the  local  mul¬ 
tiplications  needed  for  each  inner  product  operation 
form  in  parallel  in  space,  rather  than  sequentially  in 
time.  Each  inner  product  is  summed  by  a  1-D  space 
integrating  condensing  cylinder  onto  an  output  detec¬ 
tor.  Many  such  inner  product  accumulators  are  multi¬ 
plexed  in  the  orthogonal  dimension  onto  separate  de¬ 
tectors  of  a  linear  array. 

2.  Optical  processor  architecture 

The  proposed  optical  architecture  for  matrix— ma¬ 
trix  multiplication  is  shown  in  fig.  1 ,  along  with  the 
appropriate  data  flow.  The  principal  components  of 
the  system  are  a  pulsed  laser,  two  orthogonal  multi¬ 
channel  Bragg  cells  (one  with  N  channels,  and  the 
other  with  IN  -  1  channels),  a  linear  array  of  N  wide¬ 
band  photodetectors,  and  lenses.  The  optical  processoi 
is  a  2-D  array  of  N 2  analog  multipliers  configured  as  an 
anay  of  IV  space  integrating  inner  product  processors. 
With  the  appropriate  engagement  format  of  the  ma¬ 


trices  an  array  of  inner  products  is  formed  on  the  de¬ 
tector  array  during  each  processor  cycle.  As  data 
flows  through  the  Bragg  cells  the  output  appears  in  the 
same  engagement  format  as  the  input,  which  allows  di¬ 
rect  feedback  for  iterative  operations  without  latency. 

Global  system  synchronization  and  sample  defini¬ 
tion  at  the  output  are  provided  at  each  time  interval 
T ,  by  the  strobing  action  of  a  repetitively  pulsed  laser 
diode.  The  pulsed  light  is  collimated  and  incident  on 
the  first  multichannel  acousto-optic  device,  AOD1 ,  at 
the  Bragg  angle  in  the  x  dimension.  The  elements  of 
anN  X  N  matrix  A  are  applied  to  the  N  transducers 
of  AOD1  in  an  engagement  representation.  They  prop¬ 
agate  continuously  along  the*  direction  at  a  velocity 
equal  to  one  inter  transducer  spacing  of  AOD2  each  T 
s.  Rows  are  represented  in  individual  channels  as  se¬ 
quential  acoustic  pulses  separated  by  T  s.  The  nth  row 
of  the  matrix  A  is  applied  to  the  nth  transducer  of 
AOD1  with  a  delay  of  nT s.  In  this  manner  the  matrix 
is  folded  back  in  time  into  a  sliding  parallelogram  for¬ 
mat  we  call  time  engagement.  The  optical  field  emerg¬ 
ing  from  AOD1  is  spatially  filtered  in  the  Fourier 
plane  to  remove  the  undiffracted  component  and  the 
diffracted  field  is  imaged  onto  AOD2  at  the  Bragg 
angle  in  v.  For  clarity  the  image  reversal  of  the  imag¬ 
ing  system  is  ignored.  Matrix  B  propagates  in  AOD2 
in  they  direction  one  channel  separation  of  AOD1 
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Fig.  1 .  Schematic  representation  of  the  space  integrating  acousto-optic  matrix -matrix  multiplier,  with  the  associated  engagement 
data  flow.  (For  simplicity,  the  details  of  spatial  filtering  and  the  effect  of  image  reversal  are  neglected  in  this  figure.) 
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each  7 s,  orthogonally  to,  and  synchronously  with,  the 
motion  of  A .  B  is  delayed  by  (TV  -  1)7  s  with  respect 
to  A  to  allow  the  first  row  of  A  to  fully  enter  AOD1 . 
At  time  (N  -  1  +  k)T,  the  kth  column  of  the  matrix  B 
is  applied  to  transducers  k  through  k  +  N  of  AOD2.  In 
this  representation,  called  space  engagement,  the  ma¬ 
trix  is  folded  over  in  space  to  IN  -  1  parallel  channels 
which  require  N  time  cycles  to  be  completed.  The 
doubly  diffracted  light  is  imaged  in  y  and  space  inte¬ 
grated  in  x  by  the  anamorphic  lens  system  following 
AOD2.  The  light  collected  on  each  photodetector 
during  each  cycle  is  the  sum  of  the  product  of  the  ele¬ 
ments  that  are  aligned  within  the  corresponding  hori¬ 
zontal  channels  of  the  two  AODs.  As  we  will  see  in  the 
following  paragraph,  at  the  output  of  the  detector  ar¬ 
ray  we  obtain  the  product  matrix  C  =  A  X  B  in  a  time 
engagement  format. 

At  the  rVth  time  increment  the  first  row  of  matrix 
A  in  AODl  and  the  first  column  of  matrix/?  in  AOD2 
are  spatially  aligned  in  the  top  channel  of  the  system. 
The  Af  local  products  aubjl  are  calculated  in  parallel 
by  imaging  AODl  through  AOD2,  and  the  sum 
cn  =  is  produced  by  spatially  integrating 

all  these  products  onto  the  top  detector.  One  time  in¬ 
crement  T  later  the  second  row  of  A  has  fully  entered 
the  second  channel  of  AODl ,  and  simultaneously  the 
first  row  of  A  has  moved  one  column  away  from  the 
transducer.  In  the  orthogonal  dimension,  the  first  col¬ 
umn  of  B  has  moved  down  in  AOD2  one  channel  to  en¬ 
gage  the  second  row  of  A  and  produce  c21  = 
via  space  integration  onto  the  second  detector.  Concur¬ 
rently  the  second  column  of  B  has  been  applied  to 
transducers  2  through  A?  +  1 ,  in  order  to  align  with  the 
first  row  of  A  and  produce  c12  =  on 

first  detector.  In  a  similar  manner  successive  inner 
products  are  aligned,  locally  multiplied  and  globally 
accumulated  to  the  A  output  detectors.  In  a  total  of 
2N  -  1  time  increments  7,  the  output  product  matrix 
is  produced  in  a  time  engagement  format  identical  to 
the  format  of  the  matrix  A .  Therefore  it  can  be  fed  di¬ 
rectly  back  to  the  N  transducers  of  AODl  with  no  re¬ 
formatting  or  latency.  This  allows  for  fully  efficient 
pipelining  of  iterative  matrix  algorithms,  since  after 
the  matrix  A  is  initially  loaded  into  AODl  there  are 
no  more  waiting  periods  required  to  load  new  ma¬ 
trices.  For  instance,  when  the  first  element  of  the  out¬ 
put  matrix  Cj]  is  produced  the  first  row  of  A  has  been 
fully  entered  into  OAD1  so  we  can  begin  entering  the 
first  row  of  the  output  matrix  in  the  top  channel  of 


AODl .  No  interference  with  subsequent  calculations 
will  occur  because  of  the  zeroes  included  in  the  space 
engagement  formatting  of  matrix  B.  ■ 

If  the  Bragg  cells  are  operated  in  the  linear  ampli¬ 
tude  diffraction  regime,  and  coherent  detection  is 
used,  then  it  is  possible  to  make  the  outputs  of  the 
photodetectors  appear  at  the  center  frequency  of 
AODl ,  simplifying  direct  feedback.  The  coherent  im¬ 
plementation  allows  complex  valued  matrices  to  be 
represented  by  the  magnitude  and  phase  of  the  acous¬ 
tic  pulses.  If  the  Bragg  cells  are  operated  in  the  linear 
intensity  diffraction  regime  (incoherent  implementa¬ 
tion),  then  only  real  positive  matrices  can  be  repre¬ 
sented,  but  simpler  non-interferometric  detection  can 
be  employed.  In  this  case  the  output  matrix  would 
not  be  on  a  carrier,  therefore  mixers  would  be  re¬ 
quired  to  upconvert  the  output  before  amplifying  and 
applying  to  AODl . 


3.  Frequency  multiplexed  DMAC 


An  increase  in  the  accuracy  of  this  processor  can  be 
incorporated  by  the  use  of  the  digital  multiplication 
by  analog  convolution  algorithm  (DMAC)  [8-12],  at 
the  expense  of  additional  complexity.  It  is  well  known 
that  the  multiplication  of  two  time  domain  waveforms 
results  in  the  convolution  of  their  Fourier  spectra. 

This  can  be  utilized  to  implement  the  DMAC  algorithm 
by  simply  multiplying  the  frequency  multiplexed  bi¬ 
nary  representations  of  two  numbers. 

The  product  z  =  x*y  of  two  M  bit  integers  x  and y 
can  be  expressed  as  follows: 


2(Af-l)  M- 1  M- 1  , 

z=  Z/  zk2k  =(  Z/  x  2')(  S  yi2i) 

*= 0  '  1=0  *  A,*o  '  ' 


where  xi,yi  are  the  bits  in  the  binary  representation 
of  the  integers  x  and  y  and  the  coefficients 
r*  =  xjyk_i  can  achieve  M  discrete  levels.  A  time 
domain  representation  of  a  frequency  multiplexed  bi¬ 
nary  word  is  given  by  f(t)  -  1  „~qX„  exp(jnwr).  The 
product  of  two  such  waveforms  is 


h(t)=f(t)gU) 
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2(M-1) 

=  £  zkexp(jkwt).  (2) 
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Thus  the  weights  of  the  frequency  multiplexed  product 
waveform  correspond  to  an  M  level  digitally  weighted 
representation  of  the  product  of  the  two  binary  words. 
This  pseudo  binary  representation  can  be  channelized 
into  2 M  -  1  frequency  channels,  each  centered  at  kw. 
The  amplitude  of  each  spectral  component  can  be 
quantized  to  one  of  M  levels  by  an  A/D  converter,  and 
true  binary  representation  can  be  obtained  with  a  digi¬ 
tal  shift  and  add  register. 

Digital  multiplication  by  frequency  convolution 
can  be  incorporated  in  the  matrix  multiplier  of  fig.  1 
in  order  to  improve  the  accuracy  over  that  attainable 
with  analog  data  representation.  This  will  increase  the 
required  time  bandwidth  product  of  the  AODs  by  a 
factor  of  at  least  the  number  of  bits.  The  duration  of 
the  optical  and  acoustic  pulses  must  be  at  least  2 rr/w  s, 
to  permit  channelization  at  the  detector  output.  The 
frequency  multiplexed  binary  weighted  data  must  be 
encoded  in  phase  within  each  acoustic  pulse  so  that 
all  the  frequency  components  add  constructively. 

When  interferometric  detection  is  used,  the  RF  out¬ 
put  from  each  detector  will  be  the  coherent  sum  of  N 
frequency  multiplexed  multilevel  binary  weighted  sig¬ 
nals,  occupying  up  to  twice  the  original  bandwidth. 
This  format  is  compatible  with  direct  feedback  to 
AOD1  without  redigitization  in  each  cycle.  Further 
iterations  would  increase  the  required  dynamic  range 
of  each  frequency  component  and  increase  the  num¬ 
ber  of  nonzero  frequencies.  By  examining  the  Fourier 
plane  of  AOD1  we  can  determine  globally  the  num¬ 
ber  of  frequencies  occupied  for  matrix  A .  If  the  avail¬ 
able  number  of  frequency  bins  is  exceeded  by  p  ex¬ 
cess  Fourier  components,  then  we  can  perform  a  glob¬ 
al  pseudo  floating  point  rescaling  of  the  product  ma¬ 
trix  by  increasing  the  local  oscillator  frequency  used 
for  heterodyne  detection  by  pw.  The  lower  order  p 
bits  are  then  discarded  by  highpass  filtering  the  detec¬ 
tor  outputs,  or  with  a  Fourier  plane  aperture.  Redigi¬ 
tization  is  required  if  a  detectors  dynamic  range  is  ex- 


176 


ceeded  or  when  the  iterative  matrix  operation  has 
converged,  and  the  resultant  matrix  must  be  output 
in  binary  form. 

The  major  difficulty  with  incorporating  DMAC  in 
the  matrix-matrix  multiplier  is  the  complexity  of  the 
frequency  multiplexed  encoding  and  decoding,  and 
the  large  number  of  A/D  converters  required  to  con¬ 
vert  back  to  true  binary  form.  Each  of  the  N  detec¬ 
tors  must  be  channelized  into  2 M  frequency  bands, 
and  each  of  these  must  be  digitized  every  T  s  to  an  ac¬ 
curacy  of  NM.  This  could  require  as  many  as  2NM 
A/Ds,  which  is  probably  impractical.  Alternatively, TV 
faster  A/Ds  could  be  multiplexed  between  2 M  fre¬ 
quency  channels  each  by  performing  a  conversion 
each  T/1M  s.  To  decrease  the  number  of  A/Ds  even 
further  it  may  be  possible  to  digitize  only  one  detec¬ 
tor  output  at  a  time,  and  recycle  the  matrix  for  further 
conversions  by  multiplying  by  the  identity  matrix  /. 


4.  Discussion 

Acousto-optic  devices  are  attractive  transducers  for 
data  flow  optical  processors  because  of  their  sliding 
window  nature,  wide  bandwidth  (>lGHz),  large  num¬ 
ber  of  resolvable  spots  (TB>1000)  and  wide  dynamic 
range  (>60dB).  When  dealing  with  multichannel  Bragg 
cells,  however,  the  constraints  imposed  by  acoustic 
diffraction  and  electrical  crosstalk  limit  all  aspects  of 
device  performance.  Today  a  practical  limit  on  the 
number  of  channels  is  on  the  order  of  100  or  less. 
Eventually  larger  arrays  may  be  realized  through  the 
use  of  anisotropic  self  collimation  and  effective  RF 
isolation  techniques.  The  properties  of  the  multichan¬ 
nel  acousto-optic  devices  determine  the  processing 
power  of  the  matrix  multiplier  and  to  a  lesser  degree 
the  accuracy  obtainable.  In  order  to  perform  an  N  X  A' 
analog  matrix  multiplication  this  architecture  would 
require  an  N  channel  AOD  with  TB  =  2(2Ar  -  1 ) 
(AOD1),  and  a  2/V  -  1  channel  AOD  with  TB  =  2/V 
(AOD2),  where  a  factor  of  2  was  included  for  intra 
pulse  dead  time.  If  frequency  multiplexed  binary  en¬ 
coding  is  used  with  M  bits,  then  AOD1  requires  a 
TB  >Af(2^  -  1),  and  AOD2  requires  a  TB  >NM. 

The  detector  array  is  composed  of  N  parallel  wide¬ 
band  photo-detectors  whose  outputs  are  bandpass  fil¬ 
tered,  combined  with  a  steering  matrix,  amplified,  and 
fed  back  to  AOD1 .  Single  photodetectors  can  have  a 
wide  dynamic  range  (>50dB),  but  large  monolithically 
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fabricated  arrays  are  limited  by  crosstalk.  To  obtain 
the  full  dynamic  range  capabilities  of  the  detectors,  a 
powerful  optical  source  must  be  employed,  and  opti¬ 
cal  losses  minimized. 

To  obtain  an  estimate  of  the  processing  power  of 
the  space  integrating  optical  matrix  multiplier  de¬ 
scribed  in  this  letter,  let  us  consider  a  target  system 
for  multiplying  32  X  32  matrices.  AOD1  requires  32 
channels  and  a  TB  >  128,  OAD2  requires  63  channels 
and  a  TB  >  64.  If  we  assume  a  bandwidth  of  128  MHz, 
then  the  full  matrix  product  could  be  obtained  in  1  /is, 
yielding  an  analog  processing  rate  of  3.2  X  1010  mul¬ 
tiplications  per  second.  At  these  rates  the  matrix 
could  be  inverted  in  as  little  as  32  j/s  with  a  direct  algo¬ 
rithm,  or  a  fraction  of  a  millisecond  with  an  iterative 
algorithm.  If  we  desire  digital  accuracy  of  8  bits  input 
and  16  bits  output,  then  the  system  parameters  be¬ 
come  much  more  stringent.  AOD1  requires  a 
TB  >  1024,  and  AOD2  requires  a  TB  >  512,  which 
could  be  accomplished  with  a  bandwidth  of  100  MHz, 
and  a  matrix  multiplication  time  of  approximately  10 
US.  This  yields  a  processing  rate  of  3  X  109  DMAC  mul¬ 
tiplications  per  second.  However,  to  obtain  this  addi¬ 
tional  accuracy  we  require  an  array  of  32  frequency 
channelizers  with  16  frequency  bins  each,  and  32  8-bit 
A/D  operating  at  100  MHz,  temporally  multiplexed 
between  the  frequency  channels.  When  the  complexity 
of  the  electronic  peripherals  to  the  optical  processor 
reaches  this  high  level,  it  is  important  to  keep  in  per¬ 
spective  what  would  be  required  for  a  fully  digital  im¬ 
plementation.  For  instance,  for  the  same  numbers  as 
above  a  digital  array  of  32  8-bit  multipliers/accumula¬ 
tors  each  operating  at  100  MHz  can  have  the  same  pro¬ 
cessing  power  (3.2  X  109  operations/s).  In  other  words, 
comparable  electronic  hardware  is  needed  for  both  the 
digital  and  the  DMAC  optical  implementations.  The 
advantage  of  the  optical  implementation  is  in  the  re¬ 
duced  communication  rate  (320  X  106  samples/s  ver¬ 
sus  3.2  X  109  samples/s  in  this  example)  between  the 
high  speed  array  processor  and  the  system  buffer  mem¬ 
ory.  This  advantage  derives  from  the  2-D  parallelism 
of  optics  which  results  in  1024  parallel  multiplications 
being  performed  each  100  ns  interval. 


5.  Conclusion 

A  highly  parallel,  pipelined,  space  integrating, 
acousto-optic  processor  for  iterative  matrix-matrix 


multiplication  has  been  described.  The  architecture 
avoids  the  serial  readout  bottleneck  and  dynamic 
range  limitations  of  CCD  arrays  used  in  time  inte¬ 
grating  architectures.  The  wideband  nature  of  the  in¬ 
put  and  output  transducers  can  result  in  an  analog 
processing  rate  exceeding  30  GOPs  (Billion  multiplies 
per  second),  and  in  excess  of  3  GOPs  for  the  DMAC 
implementation.  Additional  accuracy  can  be  incorpo¬ 
rated  by  the  use  of  the  DMAC  algorithm  and  frequen¬ 
cy  multiplexing,  but  the  improved  accuracy  is  accom¬ 
panied  by  an  increase  in  complexity  and  expense.  The 
analog  optical  processor  can  be  implemented  with  cur¬ 
rently  available  devices  and  simple  electronic  support 
circuitry.  It  provides  extremely  high  processing  power 
with  reasonably  good  accuracy  (equivalent  to  8— 10 
bits)  due  to  the  high  dynamic  range  that  is  achievable 
with  non  integrating  photodiode  arrays. 
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Abstract 

Space-integrating,  acoustooptic  processors  for  adaptive,  temporal  filtering  are 
examined.  The  basic  architecture  is  then  extended  to  the  space-time  domain  for  application 
in  broadband  phased  array  processing.  An  acoustooptic  processor  capable  of  suck  2- 
dimensional,  adaptive  processing  is  described. 

I. Introduction 

A  major  portion  of  optimum  filtering  theory  concerns  itself  with  the  efficient 
separation  of  useful  signals  from  additive  noise.  Fixed  optimum  filters,  such  as  the 
Wiener  filter,  are  applicable  when  the  signal  and  noise  statistics  are  stationary  and  known 
apriori;  the  lack  of  such  apriori  knowledge,  however,  motivates  the  implementation  of 
adaptive  filters  which  estimate  the  required  signal  and  noise  characteristics.  The 
implementation  of  such  filtering  techniques  requires  a  processor  which  must  be  able  to 
compute  various  correlation  functions  of  signal  and  noise  and  change  its  transfer  function 
accordingly. 

The  situation  becomes  considerably  more  complex  when  one  is  required  to  adaptively 
filter  signals  in  the  space-time  domain,  as  in  the  case  of  broadband  array  processing.  The 
number  of  broadband  jammers  that  an  adaptive  processor  can  cancel  without  compromising  its 
directional  discrimination  can  be  used  as  its  performance  measure.  Electronic 
implementations  of  such  array  processors1^  have  exhibited  limited  performance  with  respect 
to  this  measure.  The  transversal  filters  responsible  for  temporally  filtering  the  outputs 
from  the  array  elements  are  of  low  order  and  hence,  operation  is  usually  limited  to 
narrowband  signals,  due  to  hardware  limitations. 

The  bandwidth  requirements  and  the  parallel  nature  of  array  processing  make  optical 
implementations  attractive.  Various  optical  implementations  have  been  explored  by 
researchers  in  the  area2*3.  In  a  recent  paper4,  we  described  two  optical  adaptive  filters 
for  use  in  the  time  domain.  These  implementations  are  strictly  one-dimensional.  requiring 
only  one  dimensional  devices,  permitting  an  extension  to  the  space-time  domain  through  the 
use  of  multi-channel  AOD's.  In  this  paper,  we  briefly  review  the  operation  of  the 
temporally  adaptive  acoustooptic  filter.  After  this  foundation  has  been  established,  an 
adaptive  array  processor  utilizing  multi-channel  AOD’s  in  a  space  integrating  architecture 
will  be  described. 

1L»  AdAfiiiXt  IBBCCXAI  flit AXA 

To  be  adaptive,  a  processor  that  optimizes  either  the  mean-square  error  or  SNR  criterion 
must  compute  various  correlation  functions  of  the  input  signal  and  noise  and  va  ry  its 
filter  response  characteristics  accordingly.  Specifically,  we  will  consider  situations 
where  the  signal  is  broadband  and  the  additive  noise  consists  of  strong,  narrowband  jammers 
whose  frequencies  are  unknown;  the  jammer  frequencies  must  be  estimated  for  effective  noise 
rejection. 

Shown  in  Fig.l  is  a  system  diagram  of  the  Passive  Processor  which  was  shown  to 
adaptively  perform  an  approximate  wiener  filtering  operation4.  The  operation  of  the  system 
can  be  explained  heuristical ly  in  the  following  manner.  Suppose  that  the  input  consists 
soley  of  a  single  sinusoid,  and  consider  the  feedback  signal,  x(t>,  with  the  loop  opened  at 
the  summing  junction.  The  input  sinusoid  is  first  convolved  with  a  replica  of  itself, 
delayed  by  •  to  produce  another  sinusoid  of  the  same  frequency,  also  delayed  by  o.  at  the 
input  of  the  correlator.  This  is  then  correlated  with  the  input  delayed  by  e  to  produce  a 
ainusoid  with  the  same  phase  as  the  input  sinusoid  appearing  at  the  summing  junction;  the 
delays,  a.  cancel  out  due  to  the  cascaded  correlation-convolution  operations.  The 
possibility  of  stable  cancellation  is  now  apparent  since  the  two  signals,  the  input  and 
feedback  signals,  which  are  subtracted  at  the  junction,  are  Identical  in  frequency  and 
phase.  Cancellation  does  not  occur  for  a  broadband  input,  because  it  correlates  poorly  with 
delayed  versions  of  itself,  resulting  in  a  negligible  feedback  signal,  S(t>.  The  passive 
processor  thus  discriminates  against  narrowband  components  of  the  input  signal,  while 
preserving  the  desired,  broadband  components  of  the  input,  making  it  suitable  for  signal 
estimation. 
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rlg.l  Passive  Processor  Pig. 2  Active  Processor 

For  signal  detection,  where  a  known  broadband  signal  is  to  be  detected  amidst  an 
additive  collection  of  narrowband  jammers  of  unknown  frequencies,  a  different  system  is 
required.  Shown  in  Fig.  2  is  s  system  diagram  of  such  a  system,  the  Active  Processor,  along 
with  a  brief,  mathematical  description  of  its  operation;  a  complete  description  can  be 
found  in  reference  4.  As  with  the  Passive  Processor,  the  basic  operation  of  this  system  can 
be  understood  using  heuristic  arguments.  Suppose  that  the  input  consists  soley  of  a  large 
amplitude  sinusoid  of  frequency  f«,  and  the  desired  waveform.  s(t>.  is  a  broadband  signal. 
With  the  loop  opened  at  the  summing  junction,  the  output,  e(t).  will  consist  mostly  of  a 
sinusoid  of  frequency  f«;  this  signal  is  then  correlated  with  the  input  to  produce  another 
sinusoid  of  the  same  frequency  at  the  summing  junction.  When  the  loop  is  closed,  the 
output  sinusoid  resulting  from  the  convolution  of  the  input  and  the  code  waveform.  s(t).  is 
ISO  out  of  phase  with  that  which  is  produced  by  the  feedback  signal,  and  hence, 
cancellation  of  the  sinusoid  takes  place.  Again,  the  feedback  signal  is  negligible  for 
small  amplitude  broadband  signals. 

Both  the  Passive  and  Active  syatems  require  convolution  and  correlation  as  the  basic 
building  blocks.  In  choosing  the  architecture  to  be  used,  we  consider  the  following 
important  requirements:  l)wide  bandwidth.  2)dynamically  controllable  convolver  and 
correlator.  ^convolver  -  correlator  compatibility.  4>large  dynamic  range.  These 
considerations  lead  us  to  choose  a  space-integrating  acoustooptic  architecture. 


Pig. >  Space-Integrating  Acoustooptic  Convolver 

Convolution  can  be  performed  with  two  AOD's  as  shown  in  Fig. 3.  The  diffracted  signal 
from  the  first  AOD  is  imaged  with  unity  magnification  onto  the  second  and,  in  the  coherent 
realization  shown,  the  diffracted  components  are  spatially  integrated  onto  a  single 
detector  whose  output  photocurrent  is 


Ij(t> 


T/2 

I  i.Jt+Oijtt-xJdT,  v-x/v,  T-W/2. 
-T/2 


(1) 


ij(t)  and  i2(t)  are  the  complex  amplitudes  of  the  AOD  input  signals,  v  is  the  acoustic 
velocity  in  the  AOD,  and  w  is  the  physical  length  of  the  AOD  aperture.  This  integral  can  be 
manipulated  to  yield  the  more  familiar  form: 

t*T/2 

ii<t>  «  /  i.uu-m-odt.  (2> 

t-T/2 


which  is  recognized  to  be  a  finite  window  convolution,  time-compressed  by  a  factor  of  two. 
The  seemingly  troublesome  compression  is  actually  an  advantage  in  this  case  as  will  be 
apparent  when  we  consider  the  correlator  Implementation. 
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;  Correlation  can  be  performed  with  the  convolution  configuration  juat  described  by  time- 

i  reversing  the  input  to  one  of  the  AOD's.  This,  however,  is  not  acceptable  for  real-time 

operation.  Shown  in  Fig. 4  is  a  space-integrating  processor  which  provides  the  relative 
motion  between  the  two  input  signals  that  is  required  for  correlation  by  using  a 
demagnifying  system  between  the  two  AOD's.  The  diffracted  light  from  the  first  AOD  is 
imaged  with  a  2:1  magnification  onto  the  second  AOD.  and  the  diffracted  light  from  both 
AOD's  is  spatially  integrated  onto  a  single  detector.  If  the  input  to  the  second  AOD  is 
time-compressed  by  a  factor  of  two.  i.e..  l4<t)  -  is(2t>,  then  the  correlator  yields 

T/4  t*T/2 

i  Ii<t)  *  /  l«(t+2*)i4(t+«)dt  -  /  i«(T)i.(t+t)d*.  (2) 

!  -T/4  t-T/2 

as  its  output.  The  above  is  seen  to  be  a  finite  window  correlation  of  the  two  signals. 
ij(t)  and  ij(t).  The  advantage  of  obtaining  the  time  compressed  output  from  the  convolver 
I  is  now  clear,  since  it  can  be  used  as  the  input  to  the  correlator  just  described  and  thus 

obtain  a  consistent,  cascaded  convolution-correlation  operation. 


The  optical  implementations  of  the  Passive  and  Active  Processors  are  shown  in  Figs.  S 
and  4.  respectively,  and  they  differ  only  in  their  electrical  interconnections.  Fig.  5(6) 
is  the  system  of  Fig. 1(2)  with  the  optically  implemented  blocks  of  Figs.  3  and  4.  in  both 
cases,  the  upper  branch  of  the  processor  computes  the  correlation  while  the  lower  performs 
the  convolution.  Since  the  convolver  and  correlator  have  a  common  input,  the  first  AOD  is 
shared.  A  more  detailed  description  can  be  found  in  the  previous  publication4. 
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Fig. 5  Adaptive  Optical  Processor  (Passive) 
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r ig.«  Adaptive  Optical  Processor  (Active) 
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A  general  adaptive  scheme  is  shown  in  Fig.!  in  which  each  channel  corresponding  to  one 
array  element  is  filtered  by  a  transversal  filter  with  n  controllable  tap  weights;  if  the 
array  has  N  antenna  elements,  then  the  array  processor  requires  the  adaptive  control  of  nN 
Independent  weights.  Therefore,  the  computational  load  for  broadband  adaptive  phased  array 
processing  is  much  heavier  than  that  for  adaptive  temporal  filtering  because  here,  the 
array  processor  must  adapt  in  two  independent  dimensions:  space  and  time. 

\ 


Pig. 7  General  Adaptive  Array  processing  Scheme 
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Optical  processors  arc  particularly  attractive  candidates  for  adaptive  broadband  array 
signal  processing  because  of  their  inherent,  multidimensional  processing  capability. 
Moreover,  the  broadband  requirement  can  be  met  by  the  use  of  broadband  multi-channel  AOD’s; 
the  large  time-bandwidth  products  that  are  available  translate  to  the  possibility  of 
implementing  very  high  order  transversal  filters.  The  acoustooptic  processor  which  we  now 
describe  is  an  extension  of  the  active  temporal  processor  described  earlier,  to  the  space- 
time  domain.  Here,  we  employ  a  combination  of  multi  and  single  channel  AOD'a  to  perform 
the  required  operations. 


The  output  of  a  general,  space-time  filter,  with  a  finite  accumulation  time  can  be 
expressed  as 


xi<T)hi(t-r)  dt. 


where  Xjtt)  is  the  signal  from  the  ith  antenna  element,  and  h<(t>  is  the  filtering  function 
in  each  channel.  A  similar  expression  is  obtained  for  the  optically  implemented  space-time 


filter  using  two  multi-channel  AOD's  shown  in  Fig.*.  The  output  of  this  filter  is 


N  t/2 

>  ( 1 /T) / 

i-1  -T/2 


x4 (t-v )hi (t*t )  dt. 


and  we  see  that  the  only  difference  from  the  general  filter  (Eq.4)  is  in  the  time 
compression  of  the  output.  It  can  be  shown  that  the  optimum  choice  for  h^(t)  in  Eq.(5> 
satisfies  the  system  of  integral  equations:  A 


j-l  'T/2 


hj (t+t •  )t2 j (t-t ' )  dt '  «  Xs^(t-t). 


where  6j(t)  is  the  desired  signal  vector  and  T^4<t)  is  the  covariance  matrix  of  the  input 
noise  given  by  J 


rjjtt)  -  E  (nj/tJnjJt-x) ] . 

ni<t)  i s  the  noise  vector  appearing  at  the  array  elements. 


Fig.t  Acoustooptic  Space-Time  Filter 


For  adaptivity,  we  need  to  calculate  and  continuously  update  the  filter  function  h^(t) 
to  drive  the  output  to  the  optimum  result.  As  with  the  previously  described  Active 
Processor,  the  output  must  be  correlated  with  the  input  to  produce  the  appropriate  filter 
function.  Since  the  array  processor  has  n  inputs  and  one  output,  this  requires  that  we 
correlate  n  signals  with  a  common  one.  This  can  be  achieved  with  the  arrangement  shown  in 
Fig. 9  which  shows  the  use  of  a  multi-channel  AOD  driven  by  the  n  antenna  element  outputs, 
in  conjunction  with  a  single  channel  AOD  which  is  driven  by  the  array  output  signal. 
Specifically,  the  output  of  the  ith  element  of  the  linear  detector  array  of  the  correlator 
is  given  by 


rA(t)  -  (l/T)  /  y(t*t)xj(t*2t)dt. 


For  proper  correlation  to  appear  at  each  output,  the  signal  driving  the  single  channel  AOD 
must  be  time-compressed  by  a  factor  of  two.  This  is  indeed  the  case  for  the  system 
described,  and  thus,  the  AOD  implemented  space-time  filter  and  the  n-chennel  correlator 
with  a  single  reference  are  compatible. 


Shown  in  Fig. 10  is  the  array  processor  system  diagram  that  shows  the  interconnections 
that  are  required;  it  is  a  direct  extension  of  the  Active  Processor  to  2-dimensions.  The 
output  from  each  antenna  element  is  correlated  with  the  processor  output  to  produce  the 
filter  function  for  that  element.  The  steering  vector.  8j(-t).  determines  the  look 
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direction  of  the  array  and  alao  la  tba  temporal  reference  signal  uaed  for  the  detection  of 
the  desired  signal,  sit).  It  can  be  derived  by  feeding  a  tapped  delay  line  with  ait);  the 
output  from  the  ith  tap  corresponds  to  s^it)  and  the  tap  spacing  is  adjusted  to  obtain  the 
proper  look  direction: 


s1<t)  -  a(t-ia) 


s(t-i(d/c)cos«) . 


where  •  is  the  desired  look  angle  from  boresight.  d  is  the  array  element  spacing,  and  c  is 
the  speed  of  light. 


Pig. 9  Multi-Channel  Acoustooptic  Correlator 


1  i  N 


proetttor  output 


Pig. is  Broadband  Adaptive  Array  Processor 

Fig. 11  shows  the  optically  implemented  adaptive  array  processor  with  the  AOD-impl emented 
space-time  filter  in  the  upper  branch  and  the  n-channel  correlator  in  the  lower  one.  By 
combining  Eqs.<7)  and  (I),  the  equation  that  determines  the  filter  function.  h<(t)  is  seen 
to  be  x 


"  T/ 2 

h1<t)-Si(-t)-<G/T,>5  //  *j(t*2P)Xj(t-T+0)h^(t*t*0)d>dx, 

i-1  -T/2  3  3 


where  G  is  the  feedback  gain.  Under  conditions  of  low  input  SNR  and  large  feedback  gain4. 
Eq.(lO)  can  be  transformed  to  the  frequency  domain  to  yield 


(G/4«*)  J  f_Z  Nj(w1)Ni(wI)sincl(<w-w1)T/(2«))d.j  • 


(11) 
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ACOUItPgptiC  ^r*-1-*  filaa«l  Processing 


John  Hong  and  Demetri  Psaltis 

California  Institute  of  Technology,  Department  of  Electrical  Engineering 

Pasadena,  California  91125 

ah««rn»f 

Acoustooptic  methods  for  adaptive  filtering  of  temporal  signals  are  discussed.  Two 
specific  architectures  are  presented:  one  utilizing  space-integration  alone  and  the  other 
combining  both  time  and  space  integrating  techniques.  Performance  issues  regarding  the 
space-integrating  system  are  discussed  in  detail,  and  a  description  and  experimental 
results  for  the  space-time  integrating  filter  are  presented. 

Background 

Optimal  filtering  in  unknown  or  time-varying  signal  environments  requires  the  use  of 
systems  which  can  compute  the  necessary  noise  characteristics  and  adapt  to  yield 
approximately  optimum  performance.  In  this  paper,  the  case  of  broadband  signals  received 
in  the  presence  of  strong,  additive,  narrowband  jammers  whose  spectra  are  unknown  is 
considered.  This  situation  is  illustrated  in  Fig.l,  showing  the  useful  broadband  signal 
overwhelmed  by  a  strong  jammer.  If  the  spectral  density  of  the  jammer  were  known  apriori, 
then  the  Wiener  filter  whose  transfer  function  is  given  by1 


HU)  - 


SB(m) 


SsU>  ♦  SnU) 


(1) 


would  be  used  to  yield  the  optimum  performance  in  the  least  mean  square  error  sense  (S£U> 
and  S_(«)  are  the  spectral  densities  of  the  signal  and  uncorrelated  jammer  noise, 
respectively).  In  the  case  of  interest,  the  noise  spectrum  is  unknown  and  must  therefore 
be  computed  and  the  system  response  adjusted  accordingly  to  approximate  the  Wiener  filter. 
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Fig.l  Optimum  Filtering 


Fig. 2  passive  Processor 


Several  optically  implemented  adaptive  systems  have  previously  been  proposed?1*'*'*  A 
block  diagram  of  the  adaptive  system  discussed  in  this  paper  is  shown  in  Fig. 2.  The  system 
has  been  described  in  detail  in  a  previous  publication1,  and  its  operation  is  briefly 
reviewed  here.  The  two  major  components  of  the  system  are  the  convolution  and  correlation 
blocks  (indicated  by  •  and*,  respectively,  in  Fig. 2).  The  outputs  of  the  convolver  and 
correlator  blocks  are  related  to  their  inputs  by 

u(t)  -  f_Z  s1(t-T)  s2(t)  dt  . 

,  .  ,  (2 ) 
W(t)  "  /_„  Sj(t*T)  s^ ( x )  dt, 

respectively,  where  si(t)  denote  the  inputs  to  the  blocks.  The  processor  discriminates 
between  narrowband  signals  which  correlate  well  with  delayed  versions  of  themselves  and 
broadband  signals  which  correlate  poorly.  Thus,  with  the  loop  open  at  the  summing  node, 
the  feedback  signal  x(t)  for  an  input  consisting  entirely  of  a  broadband  signal  is 
negligibly  small  because  such  an  input  correlates  poorly  with  delayed  portions  of  itself. 
Thi6  is  contrasted  to  the  case  where  the  input  is  a  sinusoid,  in  which  case  the  convolution 
of  the  input  with  itself  delayed,  followed  by  a  correlation  with  the  input  delayed  by  the 
same  amount  yields  a  sinusoid  of  the  same  frequency  and  phase  as  the  input.  When  the  loop 
is  closed,  broadband  components  of  the  input  feed  through  unaffected  while  suppression  of 
correlated  portions  takes  effect.  The  following  approximate  input-output  relationship  can 
be  derived  for  the  filter  in  Fig. 2*. 

z(t)  “  x(t)  -  G//.I  x(T>n*(a-«)n(t*«-t-e)  dsdt,  <j) 
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where  i ( t )  is  the  output.  n(t)  is  the  input  jammer  noise,  and  x(t)  •  s(t>  *  n(t)  is  the 
total  input.  A  simple  interpretation  is  found  by  the  Fourier  transformation  of  the  above 
equation,  resulting  in  the  following  'transfer*  function: 

Um)  l 

-  -  -  .  (4) 

X(.)  1  ♦  G  IN(-) I2 

where  Z(»).  X(«),  end  N(»)  are  the  Fourier  transforms  of  z(t),  x(t),  and  n(t), 

respectively.  Zf  the  jammer  spectrum  is  sharply  peaked  at  certain  frequencies,  the 
processor  serves  to  suppress  these  components  by  an  inverse  filtering  operation. 


fiBOSC  inteoratina  (SI)  Optical  Processor 


A,.  Description 


An  acoustooptic  convolver  can  be  implemented  using  the  SI  architecture  shown  in  Fig. 3. 
The  specific  set  up  shown  in  Fig. 3  is  a  coherent  version  of  a  geometry  which  can  just  as 
easily  be  Implemented  using  incoherent  techniques.  The  light  diffracted  from  AODi  is 
imaged  onto  AOD2,  resulting  in  two  counter-propagating  signals  at  the  exit  plane  of  A0D2. 
These  field  amplitudes  are  then  spatially  integrated  by  lens  L3,  and  the  integrated  signal 
is  detected  by  the  photodetector  to  yield  the  photocurrent,  with  a  component  proportional 
to: 

T/4 

Ij(t)  -  (2/T)  /  i^t+x)  i2(t-x)  dx.  T-W/v.  x-x/v,  (5) 

where  v  is  the  acoustic  velocity  in  the  AODs.  and  W  is  the  aperture  of  the  AOD.  A  change 
of  the  integration  variable  leads  to  a  more  familiar  form  given  by 

t+T/2 

I1(t)  -  (2/T)  ft_y/2  ij(x)  ij(2t-x)  dx.  («) 

which  is  recognized  to  be  a  finite  window  convolution,  time-compressed  by  a  factor  of  twc. 
The  complication  of  this  time  compressed  output  becomes  an  advantage  when  considering  the 
implementation  of  the  correlator. 

Aom 

fcV- fV^  xhotodetector 


ij  (t)e- ~o\ 
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Fig. 3  Space  Integrating  Convolver 


u(t)e-'“Ot 


i.rt)e-1uoT 


*1  A  rhotodetector 


w(t  V-1'ot 


Fig. 4  Space  Integrating  Correlator 

Correlation  can  be  performed  by  the  set  up  shown  in  Fig. 3  if  one  of  the  input  signals 
is  time-reversed.  Since  this  is  incompatible  with  real-time  operation,  a  different 
geometry,  one  that  is  compatible  with  the  time-compressed  output  of  the  convolver,  is 
examined.  Correlation  requires  that  the  input  signals  slide  past  each  other  without 
coordinate  inversion.  This  is  achieved  by  the  implementation  shown  in  Fig. 4  in  which  the 
diffracted  light  from  the  first  AOD  is  imaged  with  a  2:1  demagnification  onto  thi  ncona 
AOD.  At  the  exit  plane  of  the  second  AOD.  the  two  acoustic  signals  are  co-propagat i with 
different  velocities  because  of  the  demagnification.  These  signals  are  then  spair.lly 
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integrated  onto  a  single  detector.  If  the  input  signal  to  the  second  AOD  is  time 
compressed  by  a  factor  of  two,  l.e.,  i4(t)  •  is(2t).  then  the  correlator  output  is 


Ij(t)  -<2/T )/_*'*  ij <t*2T)i4<t+*)d*  -  (2 /T) j  i3 <* > i5 >dv . 


( 7  > 


•  '' 

‘  V.'v 


VS 


V  ' 


\\ 


V 


The  above  is  the  desired  finite  window  correlation  of  the  two  signals,  i3(t>  and  is(t). 
Since  the  output  of  the  convolver  in  Fig. 3  is  indeed  time-compressed  by  a  factor  of stwo. 
it  can  be  used  to  drive  the  second  AOD  of  the  correlator,  resulting  in  the  cascaded 
correlation-convolution  operation  that  is  required  in  the  passive  processor.  - 


Fig. 5  Space  Integrating  Adaptive  Optical  Processor 


Fig.#  Freq. Response  to  One  Jammer 


Shown  in  Fig. 5  1b  the  complete  processor.  Since  the  correlator  and  convolver  have  one 
common  input,  one  AOD  can  be  shared  by  the  two  blocks,  resulting  in  a  system  requiring  only 
3  devices.  The  input-output  equation  describing  the  processor  in  Fig. 5  is  given  by 


z(t)  -  x(t)  -  (4G/T x*(t+2v)x<t+T+v)z(t-**v)dvdv, 

-T/4 


(8) 


where  x(t>  is' the  input  to  the  system  and  z(t>  the  output.  For  x(t)  •  s(t)  ♦  n(t),  where 
n(t)  is  the  narrowband  jammer  and  s(t)  the  broadband  signal,  the  above  equation  can  be 
Fourier  transformed  to  yield 


Urn) 


X(«)  1  +  (G/n2)  /_!  lN(o) l2Binc2[U-«)T/4*Jda 


(9) 


The  above  'transfer’  function  has  the  form  of  the  inverse  filter  described  earlier,  except 
that  the  noise  spectrum  is  smoothed  by  a  sine  function  due  to  the  finite  time  windows  of 
the  AODs. 

EL  itil&imnass 

The  optical  system  described  thus  far  was  implemented  for  preliminary  study.  Jammej 
suppression  was  successfully  observed;  however,  the  maximum,  stable  null  depth  obtained  was 
limited  to  7dB.  It  is  important  to  theoretically  characterize  the  performance  limits  of 
the  processor  in  terms  of  system  parameters  such  as  the  AOD  aperture  size  and  detector 
noise  before  we  attempt  to  systematically  improve  the  performance  level.  Three  important 
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Issues  are  discussed:  l)  the  resolution  with  which  the  processor  discriminates  against 
jammers.  2)  null  depth  limitations  due  to  detector  noise,  and  J>  transients  in  the  system 
response  due  to  the  delays  Inherent  in  the  system. 

The  resolution  of  the  system  is  characterized  entirely  by  the  size  of  the  AOD 
apertures  for  they  determine  the  length  of  the  signal  sample  at  any  one  time.  When  the 
input  consists  of  a  single  sinusoid  at  frequency  and  amplitude  A,  the  exact  form  for  the 
Fourier  transform  of  the  output  can  be  determined  from  Eq.z  to  be 

XU) 

SU>  -  - : - : -  .  <»0> 

1  ♦  GA2  sine2 l U-»q)T/4x) 

where  ZU)  and  XU)  are  the  Fourier  transforms  of  the  output  and  input  signals, 
respectively.  A  plot  of  ZU)  for  GA2  -  «  ,T  -  10  Msecs.,  and  «0/2*  ■  10  MHz  is  shown  in 
Fig.  S.  The  sidelobe  structure  is  entirely  due  to  the  finite  apertures  of  the  AOOs.  The 
sidelobes  can  be  reduced  at  the  cost  of  widening  the  null  at  the  jammer  frequency  by 
introducing  apodization  functions  through  the  appropriate  illumination  of  the  AODs.  The 
issue  of  apodization  will  be  examined  more  closely  later  in  the  discussion  of  transients 
and  stability. 


While  the  finite  apertures  determine 
the  resolution  of  the  processor,  the 
maximum  nulling  depth  is  governed  by 
other  mechanisms.  In  order  to  better 
understand  this  limitation.  the 
deterioration  in  the  cancellation  of  one 
jammer,  n(t)  »  Aexp(j»0t).  due  to  the 
system  noise  contributed  by  the  detectors 
and  amplifiers  is  now  studied.  The 
system  model  depicting  the  noise  sources 
is  shown  in  Fig. 7,  where  n,(t)  is  the 
noise  from  the  feedback  amplifier  while 


n2(t)  and  n3(t)  correspond  to  those 
arising  from  the  photodetectors  in  the 
Fig. 7  System  Noise  Model  convolver  and  correlator,  respectively. 

The  noise  processes  are  assumed  to  be 
independent,  stationary,  complex  gaussian  processes2,  each  with  variance  «2.  Since  the 
input  is  a  single  frequency  jammer,  the  convolver  and  correlator  behave  as  narrow-bandpass 
filters  centered  at  that  frequency.  If  the  space  bandwidth  products  of  the  convolver  and 
correlator  are  larger  than  the  feedback  gain,  the  contribution  of  the  noise  sources 
n,(t).n,(t).  filtered  by  the  convolver  and  correlator  is  negligible  compared  to  n3(t)  which 
is  added  directly  onto  the  feedback  signal  x(t).  The  portions  of  noise  which  are  fed  back 
are  suppressed  by  the  correlator  and  convolver  and  can  be  neglected  to  first  order.  Thus, 
only  the  noise  due  to  n3(t)  appears  directly  at  the  output,  we  expect  that  the  performance 
limit  set  by  the  system  noise  would  not  be  reached  unless  the  jammer  amplitude  is 
suppressed  to  o,  the  noise  level.  In  our  experiments,  however,  the  jammer  in  the  output 
signal  was  clearly  stronger  than  the  system  noise,  showing  that  the  noise  performance  limit 
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Fig.t  AO  Delays 
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Fig. *  Delay  Modified  Convolver  and  Correlator 


A  more  severe  limitation  can  arise  from  the  time  delays  that  exist  in  the  AODs.  Shown 
in  Fig.t  is  an  AOD  with  the  spatial  coordinate,  x.  centered  on  the  AOD.  If  an  electrical 
signal  s(t>  is  used  to  drive  the  AOD,  then  the  amplitude  of  the  acoustic  wave  in  the  AOD  is 
proportional  to  s(t-x/v-T/2).  where  T  is  the  total  aperture  time.  This  effectively 
introduces  time  delays  to  appear  in  the  feedback  path  which  can  cause  instabilities  in  the 
processor.  To  minimize  the  delays,  the  AODs  in  the  convolver  and  correlator  can  be  shifted 
in  space  as  described  in  Fig. 9  to  result  in  the  following  convolver  and  correlator  input- 
output  equations,  including  the  delays: 

*  (4/T)  ij(t-T/2**)ij(t-*)  dr. 


convolver  : 


u(t) 


ill) 
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correlator)  w(t)  -  C4/T)  /“  4  lJ(t-T/l*ll)i4(t**)  da. 

The  resulting  Modified  system  is  described  by  the  following  equation: 

s(t)  -  *(t)  -  1«<G/T 2)  /®/4  /*/4  x*(t-T/2«2»)x<t-T/2*T«0)z<t-T-»R>dxd».  (ID 

For  s  single  jammer  input,  x(t)  »  Aexp(j»0t),  the  above  can  be  transformed  to  give  the 
following,  exact  frequency  domain  result: 

XU0> 

t(m)  m  - —  - - - - 

1  ♦  GA2  sine2 [ (e-M0)T/t«Iexp[-j (•-■0)T/4] 

The  phase  factor  present  in  the  denominator  is  due  to  the  delays.  The  consequence  of  this 
phase  factor  is  that  the  denominator  is  no  irnger  positive  for  arbitrarily  large  values  of 
G.  In  fact,  the  denominator  vanishes  for  («-«0)T/4  -  x  with  G  -  G_  -  *I/4AI  ,  indicating 
instability  for  gain  values  larger  than  Gc  which  corresponds  to  an  amplitude  suppression  of 
only  lOdB.  This  value  of  maximum  suppression  is  verified  by  computer  simulations  of  the 
processor  response  to  a  step  input.  Fig.io  shows  the  envelope  of  the  response  of  the 
processor  to  a  unit  step  jammer  input,  for  G-l.  and  G-2.5.  which  is  near  the  critical 
value.  Gc.  The  initial  constant  portion  of  the  response  is  due  to  the  delays  in  the 
convolver  and  correlator.  Indeed,  the  second  plot  shows  an  oscillatory  behavior,  indicating 
marginal  stability. 
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Fig.io  step  Response 


Fig. 11  Step  Response  with  Exponential  Apodization 

The  low  critical  gain  atems  from  the  rather  large  sidelobes  of  the  sine2  function 
coupled  with  the  phase  factor  due  to  the  delays.  At  the  cost  of  loss  in  resolution,  the 
sidelobes  can  be  reduced  by  apodizing  the  AOD  windows,  resulting  in  systems  which  car. 
tolerate  higher  feedback  gains  while  remaining  stable.  As  a  simple  example,  the  effect  of 
an  exponential  tapering  function  was  evaluated  by  computer  simulations.  Shown  in  Fig.il  is 
the  step  response  obtained  with  exponential  apodization.  Convergence  is  still  rapid,  and 
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the  suppression  is  improved  to  20dB.  Other  tapering  functions  may  yield  stable  nulling 
performance  to  match  that  predicted  by  the  system  noige  considerations  as  discussed  earlier 
but  st  the  cost  of  loss  in  resolution. 

Space-Time  intwritlnq  Optical  frPCCBlgf 

In  the  SI  system,  the  desired  correlation  function  is  formed  by  a  SI  correlator  and 
read  out  with  a  SI  convolver.  Alternative  approaches  where  integration  in  both  time  and 
space  are  used  have  been  described  by  Rhodes1  and  Penn”.  In  such  systems,  the  correlation 
integral  is  computed  by  a  time-integrating  spatial  light  modulator  (SLM)  and  read  out  with 
a  space-integrating  convolver.  We  now  consider  an  implementation  using  the  photoref ractive 
crystal  BSO  as  the  time-integrating  SLM.  The  advantages  of  this  implementation  over  the 
previous  ones5,6  which  used  the  Hughes  liquid  crystal  light  valve  and  a  phosphor  screen, 
respectively  as  the  time-integrating  SLMs  are:  Dthe  system  response  speed  is  easily 
controllable  since  the  response  time  of  the  photoref ractive  effect  depends  on  the  exposure 
level.  2)a  coherent  implementation  is  possible.  3)higher  resolution  is  exhibited  by  the 
photoref  ractive  devices.  3)since  the  crystal  does  not  respond  to  DC  or  bias  levels,  the 
implementation  will  not  suffer  from  bias  build-up  problems  common  among  time-integrating 
systems.  4)the  photoref ractive  devices  are  simpler  since  they  require  only  the  crystal  and 
a  voltage  source  to  supply  the  external  field  which  is  required  for  some  crystals. 

The  photoref ractive  effect  can  be  understood  in  the  following  way.  Two  writing  beams 
of  light  which  are  spatially  modulated  with  information  intersect  in  the  crystal  to  form  an 
intensity  grating  pattern.  Because  of  the  spatially  varying  intensity  pattern,  the  charge 
carriers  in  the  crystal  redistribute  themselves  into  a  space-charge  grating.  The  electric 
field  associated  with  this  charge  grating  accordingly  modulates  the  refractive  index  of  the 
crystal  through  the  electrooptic  effect,  allowing  the  read-out  of  the  written  information 
by  a  third  beam.  A  property  characteristic  of  this  effect  1b  that  the  response  time  is 
inversely  proportional  to  the  average  writing  beam  intensity  impinging  on  the  crystal. 
This  property  translates  to  the  controllability  of  the  system  response  time  in  the  present 
application,  an  added  flexibility.  In  our  experiments,  the  time  constant  was  on  the  order 
of  a  few  seconds  because  of  the  relatively  low  writing  intensities  used. 

Shown  in  Fig. 12  is  a  time  integrating  correlator  that  exploits  the  time  response 
characteristics  just  described.  A0D1  and  A0D2  serve  to  spatially  modulate  the  writing 
Argon  laser  beams  with  two  counter-propagating  signals  s2(t-x/v >  and  s2(t»x/v);  an  imaging 
lens  pair  is  used  to  image  the  AODs  onto  the  BSO  crystal.  The  index  grating  formed  within 
the  crystal  is  modulated  by  the  correlation  of  the  two  signals.  The  diffracted  read-out 
wave  contains  only  the  modulation  of  the  index  grating  and  is  thus  bias-free.  It  can  be 
shown  that  the  amplitude  of  the  diffracted  light  is: 

t  <t.-t)/t 

Ediff(x)  “  *  Sj ( tj -2x/v-T/2 )Bj (tj*2x/v-T/2 )  dt2,  (14) 


t-2x/V-T/2 

“  I  s. <t2)s2(t2e4x/v)  dt2. 

t-2x/v-T/2 

x  -  time  constant  of  BSO. 

which  is  the  cross-correlation  function  of  s2(t)  and  s2(t)  with  the  6patial  coordinate,  x, 
being  the  shift  variable.  This  correlation  can  be  detected  by  imaging  the  crystal  onto  a 
CCD  detector  array  for  serial  read-out. 
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Fig. 12  BSO  Correlator 
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photodetector.  The  output  current  is  the  convolution  of  the  input,  x(t),  end  the 
correlation  formed  inside  the  crystal,  and  it  becomes  the  feedback  signal,  x(t),  which  is 
then  subtracted  from  the  input  to  produce  the  output  signal.  The  resulting  input-output 
eqn.  is 


z  ( t ) 


<p/  ■  t  * 

x ( t )  -  G  x  <t'-2«-T/2)x<t-4«-T/2>z(t'*2a-T/2>dt'do. 

-T/»  t-r 


(1  5) 


which  i6  similar  to  the  SI  system  except  for  the  presence  of  both  space  and  time  integrals. 

One  underlying  assumption  behind 
Eq .  14  and  hence  IS  also,  is  that  the 
crystal  is  thin  enough  to  put  the  read 
out  process  into  the  Raman-Nath  regime. 
This  is  not  the  case,  however,  and  the 
coupling  between  the  writing  beams  must 
be  taken  into  account.  Coupled  wave 
theory  predicts  that  the  phase  of  the 
index  grating  will  be  a  function  of  the 
ratio  of  the  two  write  beam  intensities; 
this  was  found  to  be  the  case 
experimentally.  This  introduces  a 
complication  in  the  present  system 
because,  as  soon  as  the  processor  begins 
to  suppress  an  incoming  jammer,  the 
output.  z(t),  begins  to  decrease  in 
amplitude,  causing  the  ratio  of  the 
intensities  of  the  two  write  beams  which 
emerge  from  AODl  and  AOD2  to  diminish. 
This  translates  to  a  phase  change  in  the 
feedback  signal,  possibly  causing 
instability  to  appear.  This  can  be 
remedied,  however,  by  placing  an  AGC 
(automatic  gain  control)  amplifier  at  the 
input  to  A0D2.  As  adaptation  proceeds 
drop  in  amplitude  to  keep  the  input 


Fig.  13  Space-Time  Integrating  Processor 


and  z(t)  begins  to  decrease,  the  AGC  tracks  the 
of  AOD2  at  a  fixed  value.  The  system  just  described  has  been  set  up  in  the  laboratory  for 
preliminary  study.  Shown  in  Fig. 14  is  a  result  showing  the  spectrum  of  the  input  signal,  a 
jammer  at  70  MHz.  and  that  of  the  processor  output.  The  observed  suppression  was  about  15 
dB.  Better  suppression  can  be  expected  as  better  AGC  amplifiers  are  used. 
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The  incorportation  of  the  correlator  just  described  into  the  adaptive  system  of  Fig. 2 
is  rather  simple  and  requires  the  addition  of  only  l  AOD  with  a  4:1  telescope  to  compensate 
for  the  2:1  demagnification  used  in  writing  the  correlation  onto  the  BSO.  The  system  is 
shown  schematically  in  Fig. 13.  The  output  and  input  (  z(t)  and  x(t).  respectively  ) 
constitute  the  inputs  to  the  correlator.  A0D3  is  also  driven  by  the  input  signal  and 
diffracts  a  portion  of  the  Be-Ne  read  beam  to  pass  through  the  BSO  unmodulated.  The  DC 
from  A0D3 ,  however,  is  Bragg  matched  to  the  index  grating  in  the  crystal  and  reads  out  the 

correlation  function.  If  all  of  the  AODs  are  driven  at  the  same  frequency,  then  the  beam 

diffracted  by  the  BSO  crystal  and  that  diffracted  by  AOD3  are  collinear  and  interfere  .  . 

temporally  at  #«,  the  Doppler  frequency  introduced  by  AOD3.  The  two  diffracted  waves  are 

Fourier  transformed  by  lens  LJ.  and  the  resulting  intensity  is  detected  by  the 
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Fig. 14  Suppression  of  Jammer  (70  MHz)  with  BSO  Processor 
a)  input  spectrum  b)  output  spectrum 
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Two  optical  implementations  of  adaptive  signal  processors  were  described.  The  apace- 
integrating  processor  was  shown  to  exhibit  very  fast  response  tines  but  also  stability 
problems  which  could  be  corrected  to  a  large  extent  by  apodisation  techniques.  The  use  of 
such  a  processor  would  be  appropriate  in  situations  where  the  jammer  noise  is  varying 
rapidly  in  time,  such  as  in  the  case  of  blinking  jammers  or  frequency  hopped  jammers.  The 
space-time  integrating  system  was  implemented  with  a  photoref ractive  BSO  SLM  to  form  the 
necessary  correlation  function  in  conjunction  with  a  SI  convolver  for  adaptive  filtration. 
Although  considerably  slower  that  its  SI  counterpart,  it  has  the  flexibility  of  a 
controllable  response  time.  Future  research  in  photoref ractive  materials  may  yield  faster 
crystals. 
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Measurement  of  the  temporal  coherence  properties  of 
pulsed  single-mode  laser  diodes 


Michael  Haney  and  Demetri  Psattis 


The  coherence  of  a  single-mode  laser  diode,  under  high-speed  pulsed  modulation,  is  limited  by  instabilities 
in  the  lasing  wavelength  arising  from  transient  phenomena  in  the  junction  region  of  the  laser.  This  paper 
reports  the  results  of  an  experiment  to  characterize  the  effects  of  these  modal  instabilities  on  the  temporal 
coherence  of  pulsed  laser  diodes.  The  primary  intent  of  the  experiment  was  measurement  of  the  cumulative 
effect  of  the  modal  instabilities  on  the  fringe  visibility  in  interferometric  time  integrating  optical  processors. 
A  conclusion  of  this  study  is  that  commercially  available  laser  diodes  can  be  used  as  pulsed  light  Bourses  in 
interferometric  applications  in  which  the  pulse  width  of  the  laser  is  long  compared  to  its  characteristic  coher¬ 
ence  time  constant  and  short  compared  to  its  characteristic  thermal  time  constant.  Furthermore,  the  inter¬ 
pulse  modal  instability  can  be  minimized  by  prudent  choice  of  operating  conditions. 


I.  Introduction 

The  advancement  of  the  state  of  the  art  of  commer¬ 
cially  available  laser  diodes  in  recent  years  has  led  to 
their  wide  use  in  optical  communication  and  informa¬ 
tion  processing  systems.1-3  Laser  diodes  are  particu¬ 
larly  attractive  for  applications  in  which  volume  and 
power  consumption  are  constrained  due  to  their  small 
size  and  high  efficiency.  In  addition  laser  diodes  can 
be  modulated  directly  with  bandwidths  of  up  several 
gigahertz.  When  laser  diodes  are  pulsed  or  modulated 
the  spectral  purity  of  the  radiation  is  reduced  from  that 
achievable  under  cw  operation,  and  the  temporal  co¬ 
herence  decreases  accordingly.  This  paper  reports  the 
results  of  a  study  to  characterize  the  phenomena  which 
degrade  the  coherence  of  single-mode  laser  diodes  under 
pulsed  operation. 

A  primary  factor  affecting  the  coherence  of  pulsed 
laser  diodes  is  the  rise  in  temperature  of  the  junction 
area  during  the  pulse  due  to  ohmic  heating.4  This  effect 
causes  a  change  in  the  lasing  wavelength  and,  therefore, 
degrades  the  temporal  coherence.  Analytical  models 
for  this  behavior,  based  on  the  thermodynamic  prop¬ 
erties  of  the  laser  diode  structure,5-6  are  in  good  agree¬ 
ment  with  measured  results.7-8  Other  phenomena 
which  affect  the  temporal  coherence  of  pulsed  laser 
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diodes  include  the  coherence  time  constant  of  the  laser 
and  mode  hopping.  In  this  paper  these  effects  are 
characterized  individually  for  commercially  available 
single-mode  laser  diodes,  and  the  overall  coherence 
function  resulting  from  the  combination  of  the  effects 
is  modeled  and  measured. 

The  coherence  time  constant  of  the  laser  diode  is 
defined  as  the  time  after  the  onset  of  laser  oscillation  in 
which  the  laser  changes  from  its  initial  multimode  op¬ 
eration  to  a  single  dominant  lasing  mode.  The  coher¬ 
ence  time  constant  sets  a  lower  bound  on  the  pulse 
width,  since  it  must  be  a  negligible  portion  of  the  pulse 
width  to  obtain  coherence.  After  single-mode  operation 
has  been  established,  the  stability  of  the  laser  mode  is 
affected  by  junction  heating,  which  leads  to  a  continu¬ 
ous  change  in  the  lasing  wavelength  throughout  the 
duration  of  the  pulse  and  intrapulse  mode  hopping 
which  results  in  an  abrupt  change  in  wavelength.  When 
considering  time  integrating  interferometric  systems, 
where  many  pulses  may  be  integrated,  the  pulse-to- 
pulse  or  interpulse  mode  stability  must  also  be  deter¬ 
mined.  If  the  laser  does  not  consistently  select  the  same 
mode  in  which  to  oscillate  for  every  pulse,  the  coherence 
will  be  degraded.  Finally,  it  should  be  mentioned  that 
the  coherence  properties  of  the  laser  diode  are  in¬ 
fluenced  by  the  operating  conditions,  and,  therefore, 
measurements  were  made  over  a  wide  range  of  operating 
conditions. 

Most  of  the  measurements  were  made  on  the  Hitachi 
HLP-1600  laser.  Measurements  were  also  made  on  the 
Mitsubishi  ML-3001  and  RCA  C86030E  lasers  for 
comparison.  Unless  otherwise  stated,  the  data  pre¬ 
sented  are  for  the  Hitachi  device.  The  experimental 
setup  with  which  the  measurements  were  made  is  de¬ 
scribed  in  the  next  section.  The  experimental  results 
are  presented  as  well  as  the  trade-offs  that  exist  between 
performance  and  operating  conditions.  Finally,  the 
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coherence  function  for  the  pulsed  laser  diode  is  derived 
and  compared  with  the  experimental  results. 

II.  Experiment 

The  pulsed  laser  diode  coherence  measurement  setup 
is  shown  schematically  in  Fig.  1.  The  setup  is  a  Mi- 
chelson  interferometer  consisting  of  mirrors  Ml  and  M2 
and  the  beam  splitter  Si.  Mirror  Ml  is  mounted  on  a 
micrometer  stage  to  allow  variations  in  optical  path 
difference  (OPD)  from  0  to  5  cm.  Mirror  M2  is 
mounted  on  a  piezoelectric  translator  to  allow  conve¬ 
nient  monitoring  of  the  fringe  depth  at  the  output  of  the 
interferometer.  The  laser  drive  electronics  consist  of 
a  current  pulser  with  variable  rise  time  and  dc  biasing 
capability. 

The  light  at  the  output  of  the  interferometer  is  de¬ 
tected  by  a  high-speed  avalanche  photodiode  and  in¬ 
dependently  by  an  integrating  linear  photodiode  array. 
Beam  splitter  B2  permits  simultaneous  data  collection 
with  the  two  types  of  detector.  The  avalanche  photo¬ 
diode  that  was  used  is  capable  of  measuring  rise  times 
of  1  nsec.  The  photodiode  array  temporally  integrates 
the  interferometrically  detected  light  of  many  sequen¬ 
tial  pulses  to  characterize  the  pulse-to-pulse  coherence 
of  the  laser.  When  data  are  being  taken  with  the  pho¬ 
todiode  array  the  output  beams  of  the  interferometer 
are  slightly  misaligned  along  the  dimension  of  the 
photodiode  array  by  tilting  mirror  Ml.  This  produces 
a  linear  fringe  pattern  on  the  array,  and  the  fringe  vis¬ 
ibility  of  the  interference  pattern  that  is  observed  on  the 
array  is  a  measure  of  the  coherence  over  many  pulses. 

A.  Coherence  Time  Constant 

The  coherence  time  constant  is  estimated  by  mea¬ 
suring  the  time  from  the  beginning  of  detectable  light 
intensity  to  the  time  of  maximum  fringe  visibility.  This 
is  accomplished  by  modulating  the  OPD  with  mirror  M2 
by  iX/2  at  ~  1  kHz  with  the  piezoelectric  translator. 
When  many  individual  pulses  are  simultaneously  dis¬ 
played  on  the  screen  of  the  oscilloscope,  the  persistence 
of  the  screen’s  phosphor  causes  the  trace  to  smear  due 
to  the  varying  relative  phase  between  the  interfering 
beams.  This  smearing  occurs  only  when  the  laser  is 
oscillating  in  a  single  longitudinal  mode.  During  the 
start-up  period  of  the  pulse,  the  light  is  incoherent,  and 
thus  the  trace  of  many  pulses  appears  as  a  single  line. 
The  coherence  time  constant  is  approximately  the  dif¬ 
ference  between’  the  time  light  is  first  detected  as  a 
single  trace  and  the  time  of  maximum  smearing  due  to 
interference. 

Figure  2  shows  the  interferometric  activity  at  the 
leading  edge  of  the  laser  pulse.  The  first  8  nsec  of  a 
50-nsec  pulse  with  15-mW  peak  power  are  shown.  The 
OPD  for  the  data  of  Fig.  2  is  1  cm,  and  the  time  scale  of 
the  displayed  data  is  1  nsec/div.  The  envelope  of  the 
trace  in  Fig.  2  is  a  measure  of  the  modulation  depth  of 
the  interference,  and  thus  it  provides  an  estimate  of  the 
coherence  time.  The  coherence  time  constant  in  Fig. 
2  is  ~1.5  nsec.  Prebiasing  the  laser  is  a  dc  level  just 
below  the  threshold  current  of  the  laser  reduces  the 
coherence  time  constant  slightly  but  not  sufficiently  to 
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Fig.  1.  Laser  diode  temporal  coherence  measurement  setup. 


Fig.  2.  Coherence  time  measurement,  1  nsec/div. 


allow  accurate  measurements  of  the  effect  at  the  short 
(subnanosecond)  time  scale  involved. 

The  coherence  time  constants  of  the  Mitsubishi  and 
RCA  lasers  were  also  measured.  These  lasers  have 
coherence  time  constants  comparable  with  those  of  the 
Hitachi  laser  diode.  At  large  peak  power  (>35  mW), 
however,  the  coherence  time  constant  for  the  RCA  laser 
diode  became  dramatically  longer.  In  this  case,  the 
shape  of  the  interferometrically  detected  light  pulse 
indicated  that  two  or  more  competing  modes  continued 
to  oscillate  simultaneously  for  periods  of  up  to  50  nsec 
before  one  became  dominant. 

In  conclusion,  it  was  found  that  the  coherence  time 
constant  of  the  single-mode  lasers  we  tested  was  be¬ 
tween  1  and  2  nsec.  Therefore,  if  the  laser  pulse  is  much 
longer  than  2  nsec,  the  coherence  time  constant  will  not 
significantly  affect  the  coherence  properties  of  the  laser. 
For  example,  if  50-nsec  pulses  are  used,  the  laser  will  be 
oscillating  in  a  single  mode  96-98%  of  the  time. 

B.  Intrapulse  Stability 

The  intrapulse  stability  of  the  lasing  mode  is  mea¬ 
sured  by  studying  the  trace  of  the  output  of  the  ava- 
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temperature  change  on  the  phase  difference  measured 
with  the  interferometer: 

di&0)/dT  *  -2»<fA7A*.  (5) 

The  change  in  junction  temperature  during  the  be¬ 
ginning  of  laser  oscillation  has  been  modeled  as  fol¬ 
lows5: 

A TU)  -  Toll  -  eip(-t/r)),  (6) 

where  To  is  the  asymptotic  value  of  the  junction  tem¬ 
perature  change,  and  r  is  the  thermal  time  constant 
which  is  determined  by  the  thermal  resistance  and  ca¬ 
pacitance  of  the  junction.  By  integrating  Eq.  (6)  and 
substituting  in  Eq.  (7)  the  following  expression  for  the 
phase  difference  as  a  function  of  time  is  obtained: 

A/JU)  -  2Tdr0V[l  -  exp(-f/T)|/X2.  (7) 

The  change  in  junction  temperature  is  plotted  in  Fig. 

4  as  a  function  of  time  from  the  data  in  Fig.  3.  The 
phase  of  the  amplitude  modulation  is  used  as  a  measure 
of  the  change  in  junction  temperature  with  time.  The 
data  clearly  show  that  the  temperature  rise  is  expo¬ 
nential  in  nature  and  is  a  close  match  to  the  model  of  Eq. 
(7)  with  time  constants  that  are  equal  to  several  hun¬ 
dred  nanoseconds. 

The  rates  of  wavelength  shift  of  the  RCA  and  Hitachi 
lasers  were  compared  at  an  output  power  of  20  m  W  for 
100-nsec  pulse  widths.  It  was  found  that  the  wave¬ 
length  of  the  RCA  laser  shifted  at  approximately  one 
half  of  the  rate  of  the  Hitachi  laser.  This  is  attributed 
to  the  larger  optical  cavity  of  the  RCA  device  which 
leads  to  a  longer  thermal  time  constant. 

Mode  hopping  is  the  second  type  of  intrapulse  mode 
instability  that  was  observed.  This  phenomenon 
manifests  itself  as  a  discontinuity  in  the  intensity 
measured  at  the  output  of  the  interferometer.  Figure 

5  illustrates  the  effect  of  an  intrapulse  mode  hop  in  a 
20-mW  pulse.  The  OPD,  pulse  amplitude,  and  pulse 
width  were  chosen  sufficiently  large  that  the  effect  of 
the  junction  heating  as  well  as  the  intrapulse  mode 
hopping  were  observed.  The  pulse  width  in  Fig.  5  is  800 
nsec,  and  the  OPD  is  4  cm.  At  this  particular  OPD  the 
sudden  change  in  mode  during  the  pulse  manifests  itself 
as  a  step  change  in  the  phase  of  the  intensity  modulation 
of  ~180°  indicating  that  the  OPD  is  close  to  a  value 
which  is  an  integral  number  of  A2/2(5A),  where  5A  is  the 
intermode  spacing  of  the  laser. 

In  general,  the  probability  of  occurrence  of  an  intra- 
pulse  mode  hop  increases  at  higher  pulse  amplitude  and 
longer  pulse  widths.  For  the  Hitachi  laser  diode  it  was 
found  that  for  a  pulse  width  of  50  nsec,  the  frequency 
of  intrapulse  mode  hops  is  <1/40  for  a  peak  power  level 
of  12  mW  or  less.  The  RCA  laser  at  12  mW  was  found 
to  have  about  twice  the  rate  of  mode  hopping  of  the 
Hitachi  laser. 

The  rates  of  mode  hopping  given  above  are  averaged. 
The  actual  mode  hopping  rates  varied  significantly  from 
measurement  to  measurement.  Intrapulse  mode 
hopping  occurs  because  the  positions  of  the  modes  shift 
in  relation  to  the  gain  curve  of  the  laser  as  the  temper¬ 
ature  of  the  junction  region  rises  during  the  pulse.  If 


tfa*.  «»»c 

Fig.  4.  Rise  in  junction  temperature  for  different  operating 
conditions. 


Fig.  5.  Intrapulse  mode  hop,  peak  power  ■  20  mW,  bias  ”  0.  100 
naec/div. 

the  shift  is  large  enough,  an  adjacent  mode  will  move 
closer  to  the  center  of  the  gain  curve  than  the  current 
lasing  mode  and  will  take  over.  Slight  changes  in  the 
ambient  temperature  of  the  laser’s  heat  sink  will  also 
manifest  themselves  as  shifts  in  the  mode  position  rel¬ 
ative  to  the  laser's  gain  curve  thereby  changing  the  mode 
hopping  rate  and/or  the  position  within  the  pulse  at 
which  the  mode  hop  occurs. 

C.  Interpulse  Stability 

Interpulse  instabilities  occur  when  over  a  long  se¬ 
quence  of  pulses  the  laser  does  not  always  choose  the 
same  mode  in  which  to  oscillate.  This  effect  was  also 
characterized  in  the  experimental  setup  of  Fig.  1.  The 
pulse  repetition  frequency  was  set  at  20  kHz,  the  pulse 
width  at  50  nsec,  and  the  peak  power  at  10  mW.  The 
OPD  for  these  data  was  1  mm.  Under  these  operating 
conditions  intrapulse  mode  hopping  is  negligible. 
Furthermore,  the  change  in  the  phase  difference  be¬ 
tween  the  interfering  beams  due  to  junction  heating  is 
small  enough  so  that  the  resulting  output  can  be  con¬ 
sidered  a  sampled  version  of  the  cw  case.  The  OPD  was 
modulated  by  ±A/2  at  a  frequency  of  1  kHz.  Modu¬ 
lating  the  OPD  in  this  manner  reveals  the  fringe  depth 
of  the  interfering  beams.  An  interpulse  mode  hop  will 
manifest  itself  as  a  discontinuity  in  the  sampled  wave¬ 
form.  The  output  of  the  avalanche  photodiode  was 
monitored  on  the  oscilloscope,  and  an  oscilloscope  trace 
of  this  measurement  is  shown  in  Fig.  6.  Figure  6  shows 
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that  one  mode  is  dominant,  but  occasionally  an  adjacent 
mode  is  selected.  Different  modes  will,  in  general,  have 
different  relative  phases  between  the  output  beams  of 
the  interferometer.  This  causes  the  detected  intensities 
for  the  two  modes  to  be  different,  as  shown  in  Fig.  6.  It 
is  clear  that  for  time  integrating  interferometric  sys¬ 
tems,  in  which  the  light  from  many  laser  pulses  is  de¬ 
tected  interferometrically  and  summed,  interpulse 
mode  hopping  could  severely  degrade  the  fringe  visi¬ 
bility  and  thus  must  be  minimized. 

As  with  the  intrapulse  mode  hopping,  the  rate  of  in¬ 
terpulse  mode  hops  was  found  to  be  determined  by  the 
electrical  operating  conditions  of  the  laser.  In  general, 
the  laser  was  more  stable  (a  single  mode  was  more  likely 
to  dominate)  at  lower  peak  power  levels.  This  is 
probably  due  to  the  more  gradual  buildup  of  laser  os¬ 
cillation  at  the  lower  drive  current  levels  resulting  in 
more  consistent  selection  of  the  dominant  mode.  It  was 
also  found  that  the  rate  of  mode  hopping  could  be  sig¬ 
nificantly  reduced  by  altering  the  shape  of  the  current 
drive  pulse  to  have  a  slower  rise  time.  Measurements 
of  the  interpulse  mode  hopping  rates  were  made  for 
different  drive  pulse  shapes  and  peak  power  levels.  For 
these  measurements  the  slope  of  the  leading  edge  of  the 
drive  pulses  was  varied  while  maintaining  the  peak  level 
pulse  width  at  ~50  nsec.  Figure  7  shows  oscilloscope 
traces  showing  the  shapes  of  typical  drive  pulses  that 
were  compared.  For  the  Hitachi  laser  it  was  found  that 
for  10-nsec  rise  times,  the  interpulse  mode  stability  was 
>95%  for  peak  power  levels  below  6  mW.  However,  for 
drive  pulses  with  rise  times  of  80  nsec,  such  as  in  Fig. 
7(b),  the  laser  diode  exhibited  >95%  stability  for  peak 
power  levels  up  to  12  mW.  For  rise  times  >80  nsec  no 
measurable  improvement  in  the  interpulse  mode  sta¬ 
bility  was  observed.  Furthermore,  it  was  noted  that 
applying  a  dc  bias  current  to  the  laser  at  a  level  below 
the  threshold  current  did  not  significantly  affect  in¬ 
terpulse  stability. 

D.  Coherence  Function  Measurement 

The  four  types  of  instability  phenomenon  that  were 
discussed  in  the  previous  sections  combine  to  degrade 
the  fringe  visibility  in  an  interferometric  system.  The 
relative  importance  of  these  instabilities  to  coherence 
degradation  depends  on  the  operating  conditions  of  the 
laser  diode  and  the  OPD  of  the  optical  system.  The 
effect  of  the  coherence  time  constant  is  minimal  if  it  is 
short  when  compared  to  the  pulse  width.  For  the 
measurements  reported  here  this  condition  was  gener¬ 
ally  met,  and,  therefore,  the  coherence  time  constant 
was  a  minor  factor.  Furthermore,  we  found  that  in¬ 
trapulse  and  interpulse  mode  hopping  are  minimized 
by  proper  choice  of  operating  conditions. 

For  example,  with  the  Hitachi  laser  at  a  peak  power 
of  10  mW,  the  combined  intrapulse  and  interpulse  mode 
hopping  occurs  at  a  rate  of  less  than  1  mode  hop  in 
twenty  pulses  for  a  current  drive  pulse  whose  shape  is 
similar  to  that  of  Fig.  7(b).  The  most  significant  in¬ 
stability  is  the  wavelength  shift  due  to  the  heating  of  the 
junction  area  during  the  pulse.  To  maintain  a  high 
degree  of  coherence  for  a  particular  OPD,  the  pulse 
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Fig.  6.  InUrpulse  mode  hopping. 


W  <b) 


Fig.  7.  Laser  drive  pulses:  (a)  10-nsec  rise  time;  (b)  80-nsec  rise 
time. 


Fig.  8.  Fringe  pattern  generated  by  10,000  interferometrically  de-  ( 
tec  ted  LD  pulses. 

width  must  be  such  that  the  intensity  measured  at  the 
output  of  the  interferometer  will  fluctuate  only  a  frac¬ 
tion  of  one  of  the  cycles  shown  in  the  examples  of  Fig. 
3. 

Evaluation  of  the  combined  effects  of  the  individual 
instabilities  on  the  visibility  of  the  interference  pattern 
that  results  from  the  integration  of  many  sequential 
pulses  was  accomplished  by  studying  the  output  of  the 
photodiode  array.  Figure  8  is  an  oscilloscope  trace  of 
the  array  output.  The  trace  represents  the  time  inte¬ 
grated  interferometric  response  of  ~10,000  individual 
laser  pulses  over  a  period  of  50  msec.  The  data  shown 
were  taken  at  approximately  zero  OPD  and  thus  rep¬ 
resent  the  largest  attainable  fringe  depth.  In  the  ex¬ 
ample  of  Fig.  8  the  pulse  width  is  50  nsec.  The  actual 
fringe  depth  achieved  is  not  100%  because  of  several 
imperfections  of  the  system.  The  photodiode  array  has 
dark  noise  and  signal  spreading  which  will  lead  to  bias 


contributions.  Furthermore,  the  very  short  multimode 
portion  at  the  beginning  of  each  pulse  adds  incoherently 
to  result  in  a  contribution  to  the  bias. 

A  measurement  of  the  fringe  visibility,  normalized 
to  the  maximum  fringe  visibility  obtained  at  OPD  =  0, 
as  in  Fig.  8,  provides  a  direct  measurement  of  the  co¬ 
herence  function  under  different  operating  conditions. 
The  measured  fringe  visibility  as  a  function  of  OPD  for 
different  pulse  widths  is  plotted  in  Fig.  9.  In  these  data 
the  effects  of  mode  hopping  have  been  minimized, 
leaving  junction  heating  as  the  primary  factor  that  is 
responsible  for  reduced  fringe  visibility. 

III.  Coherence  Function  Analysis 

In  this  section  we  derive  the  coherence  function  for 
pulsed  laser  diodes  based  on  the  model  of  the  thermo¬ 
dynamic  properties  of  the  laser  junction  given  in  Eq.  (6). 
The  coherence  function  analysis  is  then  extended  to 
time  integrating  systems  by  including  the  effect  of  in¬ 
terpulse  mode  hopping. 

The  coherence  time  constant  of  a  single-mode  laser 
diode  has  been  treated  theoretically  in  the  literature.11 
It  was  predicted  that,  at  moderate  to  high  peak  power 
levels,  one  longitudinal  mode  dominates  very  rapidly 
(~1  nsec)  after  the  onset  of  laser  oscillation.  This  is  in 
good  agreement  with  our  measurements.  The  coher¬ 
ence  time  phenomenon  made  a  negligible  contribution 
to  the  coherence  degradation  when  the  pulse  width  is 
very  long  compared  to  the  coherence  time  constant. 
We  assume  this  to  be  the  case  and  neglect  this  effect  in 
our  analysis.  We  also  ignore  intrapulse  mode  hopping 
because  it  was  also  negligible  under  the  operating  con¬ 
ditions  used.  Therefore,  the  dominant  phenomena 
degrading  the  coherence  of  the  laser  are  the  intrapulse 
modal  instability  due  to  junction  heating  and  interpulse 
mode  hopping. 

For  a  single  pulse,  the  coherence  function  of  the  sin¬ 
gle-mode  laser  diode  is  assumed  to  be  determined  solely 
by  the  junction  heating  as  modeled  by  Eq.  (6).  This 
effect  is  deterministic,  and,  therefore,  in  this  case  the 
coherence  function  does  not  involve  ensemble  averages. 
The  coherence  function  for  multiple  pulses,  on  the  other 
hand,  with  interpulse  mode  hopping,  in  stochastic  in 
nature.  We  will  first  derive  an  expression  for  the  effects 
of  junction  heating  and  then  add  the  effects  of  random 
interpulse  mode  hopping. 

The  electric  field  at  the  output  of  the  interferometer 
is  given  by 
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Fig.  9.  Measurements  of  the  modulus  of  the  coherence  function  for 
10,000  time  integrated  pulses. 
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Fig.  10.  Theoretical  modulus  of  the  coherence  function. 

We  now  write  an  expression  for  the  normalized  coher¬ 
ence  function  as  a  function  of  the  OPD: 

G(d)  =*  (exp[/ta>U)fl  expl— ;jui(t)(f  -d/c)]|>,  (11) 

where  < )  indicates  time  average  over  the  pulse  duration 
P.  In  (11)  u>(t  -  d/c)  is  approximated  by  o>(f)  because 
—d/c  is  negligible  with  respect  to  t.  We  havf 

G(d>  -  1/P  f  PexpOMOd/c]tdt.  (12) 

J  0 

Substituting  in  Eq.  (10)  and  using  the  assumption  that 
P  «  t,  so  that  exp(-(/r)  as  1  —  t/r  on  the  interval  P, 
the  integration  in  Eq.  (12)  can  be  performed  in  closed 
form: 


E  «  exp[/u>(t)t]  +  exp[>o)(t  -  d/c)(f  -  d/c)],  (8) 

where  d  is  the  OPD  of  the  interferometer  and  u(t )  is  the 
laser’s  oscillating  frequency  which  changes  with  time 
due  to  the  junction  heating  effect.  From  (7)  the 
wavelength  as  a  function  of  time  is  given  by 

A(r>  -  A,  +  7oA'|l  -  exp(-t/r)|,  (9) 

where  X,  is  the  lasing  wavelength  at  the  start  of  the 
pulse.  Since  the  change  in  wavelength  due  to  the 
junction  heating  is  small  compared  with  A,  ,  we  have 

wit)  -  2»c/XU)  »  <2*c/X,)|l  -  XT0U  -  exp(-l/r)l/X,|  (10) 


G(d)  «  sinc(dciP)  expt/2x(d/X,  -  dciP/2)],  (13) 

where  ci  =  X'To/X?r  and  sinc(x)  =  sin(irx)/irx. 

The  fringe  visibility  V  is  defined  as  the  magnitude  of 
the  coherence  function.  Hence,  for  pulse  widths  much 
less  than  the  thermal  time  constant,  we  have 

V »  |sinc(dciP)|  *  (14) 

Equation  (14)  is  plotted  in  Fig.  10  for  pulse  widths  of 
50  and  100  nsec.  A  thermal  time  constant  of  350  nsec 
is  assumed.  The  measured  fringe  visibility  (Fig.  9)  is 
in  good  agreement  with  Fig.  10.  Note  that  the  effect  of 
a  large  pulse  amplitude  on  the  coherence  function  would 
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Fig.  11.  Calculated  effect  of  interpulse  mode  hopping  on  the  mod¬ 
ulus  of  the  coherence  function. 

be  to  increase  T0  and  hence  ct  in  Eq.  (14),  thus  leading 
to  lower  coherence. 

We  now  analyze  the  fringe  visibility  for  the  case  of  two 
competing  adjacent  longitudinal  modes.  The  two 
modes  have  frequencies  u>i(t)  and  0)2(1)  =  u\(t)  f  6o>, 
where  iw  is  the  Fabry-Perot  mode  spacing  of  the  laser 
diode.  The  time  dependence  is  assumed  to  be  due 
solely  to  the  junction  heating  effect.  We  assign  p  and 
1  -  p  to  be  the  probabilities  of  occurrence  of  the  two 
modes.  For  any  one  pulse,  only  one  of  the  two  modes 
exists,  and  thus  the  coherence  function  for  multiple  time 
integrated  pulses  is 

Gt(d)  **  £(<expl/«j(f)r|  expl-yjuil/Xt  -d/c)]|>).  (15) 

Using  Eq.  (13)  we  find 

C2<d)  *  expl/(u)i jd/c  -  xdciP)]  sinddci P) 

x  |p  +  (1  -  p)  expL/(6w)d/c]|,  (16) 

where  we  have  ignored  the  insignificant  differences  in 
the  phase  term  and  in  the  argument  of  the  sine  function 
for  the  two  modes,  o>u  and  «2,,  *  wi.i  +  6w  are  the 
initial  lasing  frequencies  for  two  modes.  Hence  the 
fringe  visibility  is  given  by 


V2  -  IsinddcP)^  -  2p  +  1  +  2p(l  -  p)  oa[(M<f/c]|1/2.  (17) 

This  function  is  plotted  in  Fig.  11  for  p  =  0,  p  ■  0.1,  and 
p  =  0.5  for  a  pulse  width  of  100  nsec.  Figure  11  depicts 
the  degradation  in  coherence  due  to  the  interpulse  mode 
hopping  instability. 
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Abstract 

The  acousto-electro-optic  (AEO)  interaction  that  is  presented  in  this  paper  is  based  on 
the  combined  Acousto-optic  (AO)  and  Electro-optic  (EO)  effects.  The  effect  is  analyzed  and 
demonstrated  experimentally.  The  application  of  AEO  interaction  to  light  modulation  and 
deflection  are  discussed. 


I.  Introduction 


The  most  widely  used  methods  for  wideband  light  modulation  are  either  the  acousto¬ 
optic*3*  or  the  electro-optic*^*  effects.  Each  type  of  modulator  suffers  from  its  own 
distinct  limitations.  For  instance  in  an  AO  modulator  there  is  a  tradeoff  between  band¬ 
width  and  diffraction  efficiency.  A  small  transducer  provides  a  large  bandwidth  but  at 
the  expense  of  reduced  diffraction  efficiency  and  vice-versa.  An  EO  modulator  in  an 
anisotropic  crystal  has  low  angular  aperture,  requires  high  voltage  and  it  is  configured 
with  polarizers  and  a  phase  retarder  requiring  tedious  alignment.  When  a  modulator  is 
implemented  using  the  combined  A-0  and  E-0  effects  a  new  flexibility  is  introduced *3' with 
which  we  can  overcome  some  of  the  limitations  of  the  two  individual  modulators. 


In  this  paper  the  A-E-0  interaction  is  introduced  (Section  2)  and  experimentally  con¬ 
firmed  (Section  3) .  An  assessment  of  the  properties  of  an  AEO  modulator  is  presented  in 
Section  4  and  in  Section  5  we  discuss  the  use  of  the  A-E-0  effect  as  a  lioht  deflector. 

I I .  Acousto-electro-optic  interaction 

The  basic  configuration  of  an  AEO  modulator  is  shown  in  Fig.  1.  The  device  is  operated 
in  a  normal  configuration  of  an  anisotropic  acousto-optic  modulator.  An  acoustic  wave  is 
launched  in  the  crystal  by  the  piezoelectric  transducer  and  the  device  is  illuminated  at 
the  Bragg  angle.  In  addition,  electrodes  are  deposited  on  the  crystal,  so  that  a  high 
voltage  can  be  applied  and  thus  an  electric  field  introduced  in  the  crystal,  at  the  same 
time . 


Figure  1.  Basic  configuration  of  the 
AEO  device. 


Figure  2.  Phase  matching  diagram  of  the 
AEO  interaction 
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The  acousto-optic  interaction  is  analyzed  by  coupled  modes  analysis (*>  which  can  be 
schematically  represented  by  a  phase  matching  diagram  (fig.  2).  The  solid  curves  in  the 
figure  represent  the  wave-normal  surfaces  of  the  crystal  without  the  external  voltage. 

When  an  external  voltage  is  applied  to  the  two  electrodes  of  Fig.  1,  the  shape  of  the  index 
ellipsoid  changes  due  to  the  E-0  effect  and  the  wave-normal  surfaces  move  accordingly 
(dotted  curves  in  Fig. 2).  For  simplicity  we  depict  the  case  that  only  the  outer  curve 
changes.  Assuming  that  the  crystal  is  aligned  for  perfect  Bragg  matching  for  zero  applied 
voltage,  then  by  applying  the  voltage  a  phase  mismatch  is  introduced  and  the  diffracted 
light  intensity  varies  according  to  the  amplitude  of  the  external  voltage. 


The  intensity  of  the  light  diffracted  in  the  first  order  for  phase  mismatch  equal  to 
A K  is  given  by'*' 


(1) 


lin  n[sinc  (Vn  +  ( AKL/2 ) 2] 2 


where 


I^n  -  incident  light  intensity 


n  -  diffraction  efficiency  of  the  acousto-optic  interaction 
L  -  interaction  length 


If  we  define  the  voltage  v*1"0  as  a  measure  of  the  electrically  induced  phase  mismatch  in 
the  AEO  effect,  satisfy  the  following 


(2) 


AKL 


irV 


2  v^0  ' 

then  vAE0  is  given  by: 


(3) 


vAEO 


where  X-wavelength,  n-refractive  index,  h-height  of  the  crystal  An  the  relevant  combination 
of  electro-optic  coefficients  and  V  is  the  applied  voltage,  v*110  is  approximately  equal 
to  both  the  half-wave  voltage  of  the  A-E-0  modulator  and  to  the  half  voltage  of  the  same 
device  utilized  as  an  E-0  transverse  modulator.  We  can  rewrite  (1)  in  terms  of 

V^0  as  follows: 


(4) 


Jin 


n[sinc  ( 


2]2 


This  is  the  diffracted  light  intensity  formula  of  the  AEO  interaction  and  we  can  see  that 
this  is  a  direct  effect,  i.e.,  the  modulation  function,  in  Eq.  (4),  is  not  simply  the 
product  of  the  electro-optic  and  acousto-optic  effects. 


Ill .  Experiments 


An  experimental  device  was  constructed  to  verify  the  A-E-0  interaction.  (A  photograph 
of  the  device  is'shown  in  Fig.  3).  The  device  was  constructed  from  a  Y-cut  LiNb03  crystal 
with  dimensions  40x7x12  (x-y-z)  mm.  Two  electrodes  were  evaporated  on  the  (0,1,0)  surfaces 
and  connected  to  a  high  voltage  power  supply.  An  acoustic  transducer,  mounted  on  the 
(1,0,0)  surface,  launches  a  transverse,  y-polarization ,  acoustic  wave  in  the  x-direction. 

A  beam  from  a  He-Ne  laser  propagates  near  the  z-axis  (1.8°  from  z-axis) .  The  intensity  of 
the  diffracted  light  (normalized  to  n  I^n>  is  plotted  in  Fig.  4  as  function  of  the 

voltage  (normalized  to  ,  The  theoretical  (solid)  curve  is  given  by  Eq.  (1)  and<4). 
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In  this  experiment  V^0  was  6  kV  and  n »  the  diffraction  efficiency  was  2%. 
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Figure  A.  Experimental  results  of  an  AEO  modulator. 

- :  Theoretical  Curve  INTENSITY  -  [SINC  (VOLTAGE)]2 

O  :  Experimental  Data,  VOLTAGE  *  irV/yAEO 

v“°  -  6  kV 

The  experimental  results  are  in  excellent  agreement  with  the  theoretical  curve. 

IV.  A-E-0  modulator 

The  simplest  device  that  can  be  implemented  with  the  AEO  interaction  is  a  light 
modulator,  in  the  arrangement  of  the  experiment  discussed  in  the  previous  section. 
Specifically  if  the  acoustic  signal  consists  of  a  single  fixed  frequency  (the  center 
frequency  of  the  device)  with  constant  power,  then  the  diffracted  light  intensity  can  be 
modulated  by  varying  the  voltage  applied  across  the  electrodes  of  the  device,  in  accordance 
to  the  curve  in  Fig.  4.  Interestingly,  the  same  device  can  be  used  as  either  an  acousto¬ 
optic  modulator  by  temporally  modulating  the  acoustic  power  or  alternatively  as  an  electro¬ 
optic  modulator  by  varying  the  applied  voltage  and  observing  the  transmitted  light  through 
crossed  polarizers.  In  this  section  we  compare  the  AEO  modulator  to  the  properties  of  the 
two  individual  modulators.  The  bandwidth  of  the  AEO  modulator  is  limited  primarily  by  the 
electrical  driving  circuit  with  which  the  voltage  is  applied  across  the  electrodes. 

The  piezoelectric  transducer  does  not  affect,  in  any  way  the  bandwidth  and  therefore 
it  can  be  designed  to  maximize  the  diffraction  efficiency  by  increasing  the  transducer 
(and  thus  the  interaction)  length. 
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In  addition  the  acoustic  transit  time  limitation  that  is  associated  with  the  AO 
modulator  is  not  encountered  here  and  thus  an  extended  optical  beam  can  be  modulated. 
Therefore  the  temporal  characteristics  of  the  AEO  modulator  are  similar  to  the  character¬ 
istics  of  the  EO  modulator  which  are  generally  superior  to  those  of  the  AO  modulator.  The 
spatial  characteristics  of  the  AEO  modulator,  on  the  other  hand,  are  the  same  as  the  AO 
modulator.  The  modulated  light  is  angularly  separated  from  the  unmodulated  light  and  thus 
the  need  for  cross  polarizers  is  eliminated.  The  AEO  modulator  works  with  unpolarized 
light  as  well  (with  a  loss  in  diffraction  efficiency  by  a  factor  of  2)  and  in  general  the 
alignment  of  the  AEO  (and  AO)  modulator  is  less  tedious.  For  instance,  the  numerical 
aperture  of  the  AEO  device  we  discussed  in  the  previous  section  is  1.1s  an  EO  device 
using  the  same  crystal  has  only  .6s  numerical  aperture.  The  interaction  geometry  of  the 
AEO  modulator  can  be  optimized  to  yield  several  degrees  of  numerical  aperture. This  is 
the  most  important  advantage  of  the  AEO  modulator  over  the  EO  device. 

The  modulation  curve  of  the  AEO  modulator  (diffracted  intensity  vs.  applied  voltage) 
is  given  by  Eqs.  (1)  and  (4)  and  is  plotted  in  Fig.  4.  This  modulation  curve  is  different 
from  the  EO  or  the  AO  modulators,  but  the  linear  dynamic  range  that  can  be  obtained  from 
the  modulator  is  approximately  the  same.  For  instance  we  have  compared  the  linearity  of 
the  AEO  and  EO  modulators  by  calculating  the  modulation  depth  obtained  in  the  two  cases 
when  the  third  harmonic  of  modulation  is  set  to  1%  of  the  fundamental  in  both  cases.  The 
modulation  efficiency  in  this  case  is  441  for  the  AEO  modulator  and  48%  for  the  EO 
modulator. 

The  voltage  level  that  is  required  in  the  AEO  device  is  similar  to  that  needed  ir.  a 
transverse  EO  modulator.  The  required  voltage  can  be  reduced  by  increasing  the  interaction 
length,  reducing  the  height  of  the  device  and  using  materials  with  higher  electro-optic 
constants.  The  geometrical  improvements  can  be  most  conveniently  accomplished  through  the 
use  of  surface  acoustic  waves  and  optical  waveguides.  This  is  a  possibility  we  are 
currently  exploring. 

V.  Acousto-electro-optic  deflector 

Another  possible  use  of  the  AEO  interaction  will  be  to  build  an  AEO  phase  mismatch 
compensated  deflector. 


The  number  of  resolvable  spots  in  an  AO  deflector  is  given  by  (1) 


N 


A9_ 

;  A6o 


\ 

nD  ' 


where  A9T  is  the  total  deflected  angle,  X  is  the  optical  wavelength,  n  is  the  index  of 
refraction  and  D  is  the  optical  aperture.  A9T  is  given  by  the  bandwidth  of  the  deflector. 

This  bandwidth  is  given  by  the  transducer  bandwidth  and  the  phase  mismatch  introduced  by 
the  deviation  of  the  scanning  acoustic  wave  frequency  from  the  center  frequency.  If  the 
appropriate  voltage  is  applied  to  compensate  the  phase  mismatch  introduced  for  each  scan¬ 
ning  frequency,  a  larger  bandwidth  can  be  obtained  and  therefore  a  larger  total  deflection 
angle  and  a  larger  number  of  spots.  The  compensating  voltage  is  approximately  linear  in 
the  phase  mismatch,  AK  and  therefore  also  linear  in  the  change  in  frequency  f  -  f  . 


The  device  discussed  in  section  3  was  also  used  to  demonstrate  the  AEO  deflector. 

The  results  of  these  experiments  are  shown  in  Fig.  5.  The  normalized  intensity  of  the 
diffracted  light  obtained  with  and  without  the  compensating  voltage  is  plotted  as  function 
of  the  acoustic  frequency.  The  compensating  voltage,  as  function  of  acoustic  frequency  is 
plotted  in  the  sAme  figure.  From  Fig.  5  we  can  see  that  the  bandwidth  of  the  AEO  deflector 
is  about  2.5  times  larger  than  that  of  the  AO  deflector  and  is  limited  by  the  electrical 
bandwidth  of  the  transducer.  As  expected  the  compensating  voltage  is  linear  in  f  -  f  . 
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Figure  S.  Experimental  results  of  a  phase-mismatch 
compensated  Amo  deflector 

A.  Ideal  response  of  the  Compensating  Deflector. 

B.  Real  deflected  light  intensity  of  the  Compensating 
Deflector  due  to  the  transducer  bandwidth. 

C.  Deflected  light  intensity  without  compensating  voltage. 

D.  Compensating  Voltage. 


VI.  Conclusion 


The  most  important  characteristic  of  the  AEO  effect  is  the  increased  flexibility  in 
the  design  that  results  from  the  additional  modulating  signal.  This  can  allow  the  design 
to  overcome  some  of  the  limitations  imposed  by  the  individual  EO  and  AO  interactions. 

The  AEO  effect  can  prove  to  be  of  particular  significance  in  the  area  of  optical 
signal  processing  where  the  direct  interaction  among  the  three  input  signals  to  the  device 
(optical,  acoustic,  electrical)  can  allow  signal  processing  operation  to  be  efficiently 
performed. 

The  principal  limitation  of  the  AEO  effect  is  the  high  voltage  requirement  in  our 
present  device.  We  are  exploring  several  methods  for  reducing  the  required  voltage 
including  the  use  of  planar  technology  (surface  acoustic  waves  and  optical  waveguides) (7) 
and  the  resonant  piezoelectric  effect. 

Acknowledgement 

The  research  reported  in  this  paper  is  supported  in  part  by  the  Air  Force  Office  of 
Scientific  Research. 

References 

1.  I.  C.  Chang,  IEEE  Trans.  Sonics  Ultason.  SU-23,2  (1976). 

2.  A.  Yariv,  "Introduction  to  Optical  Electronics,"  (Holt,  Reinhart  and  Winston,  1976). 

3.  James  J.  Wiczer  and  Henry  Merkelo,  Appl.  Phys.  Letters  30,  439  (1977). 

4.  J.  M.  Rouvaen,  M.  G.  Ghazaleh,  E.  Bridoux  and  R.  Torquet,  J.  Appl.  Phys.  50 (60 ) 

5472,  August  1979. 

5.  I.  C.  Chang,  Appl.  Phys.  Letters  25,  370  (1974). 

6.  G.  Sirat,  Y.  Fisher  and  N.  Ben  Yosef,  Proceeding  of  SPIE  Vo.  465 

7.  J.  M.  Hammer,  "Modulation  and  Switching  of  Light  in  Dielectric  Waveguides,”  Integrated 
Optics,  Topics  in  Applied  Physics,  Vol.  7,  pp.  138-200,  Springer-Verlag  Berlin 
Heidelberg,  New  York,  1979. 


•y  •  ;■ 


>7  .  I 


v  v; 
V>* 


.  *\  «*. 

■■  •% 


'.V, 


:v 


>V, 

V  - 

•>v 

.\V.\ 


»: 


Acousto-electro-optic  light  modulation 

Oemetri  Psaltis,  Hyuk  Lee,  and  Gabriel  Sirat 

California  Institute  of  Technology.  Pasadena.  California  91125 

(Received  24  September  1984;  accepted  for  publication  12  November  1984) 

The  acousto-electro-optic  effect  is  analyzed  and  demonstrated  experimentally.  The  application  of  , 
the  acousto-electro-optic  effect  to  light  modulation  and  deflection  is  discussed. 

The  most  widely  used  methods  for  wideband  light  mo-  duced  with  which  we  can  overcome  some  of  the  limitations 
dulation  are  either  the  acousto-optic  (AO)1  or  the  electro-  of  the  two  individual  modulators. 

optic  (EO)2  effects.  Each  type  of  modulator  has  its  own  The  basic  configuration  ofanAEO  modulator  is  shown 

strengths  and  suffers  from  its  own  distinct  limitations.'  in  Fig.  1.  The  device  is  operated  in  the  normal  configuration 
When  we  use  AO  and  EO  effects  simultaneously,4  the  of  an  anisotropic  AO  modulator.  A  single  frequency  acous- 
acousto-electro-optic  (AEO)  effect,  anewflexibility  is  intro-  tic  wave  is  launched  in  the  crystal  by  the  piezoelectric  trans- 
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FIG.  1.  Basic  configuration  of  the  AEO  device. 

ducer  and  the  device  is  illuminated  at  the  Bragg  angle  corre¬ 
sponding  to  the  given  frequency.  The  AO  interaction  is 
analyzed  by  coupled  mode  analysis.’  At  the  Bragg  angle,  the 
diffracted  light  intensity  is  maximum.  If  there  is  a  phase 
mismatch  AK ,  the  diffracted  light  intensity  la  is  given  by 
(the  approximation  77  <  1 ) 

h  —  ^/in  (sinc[»7  4-  (AKL  /2)2] 1/2 1 2 

=»?/,„  [  sinc(d/TZ.  /2)]2,  (I) 

where  /,„  is  the  incident  light  intensity,  7  is  the  diffraction 
efficiency  of  the  AO  interaction,  L  is  the  interaction  length, 
and  sinc(jc)  =  [sin(x)]/x.  In  the  AEO  device  electrodes  are 
deposited  on  the  crystal,  so  that  an  external  electrical  field 
can  be  applied  in  addition  to  the  acoustic  wave.  The  applica¬ 
tion  of  the  external  field  causes  a  deformation  of  the  index 
ellipsoid  due  to  the  EO  effect,  and  the  wave-normal  surfaces 
move  accordingly.  Consequently,  a  phase  mismatch  AK  is 
introduced  and  the  diffracted  light  intensity  varies  accord¬ 
ing  to  the  amplitude  of  the  external  voltage.  The  phase  mis¬ 
match  introduced  by  the  anisotropic  AEO  effect  is  given  by 

121 

where  A  is  the  wavelength  of  the  light  in  vacuum,  n,  and  n2 
are  indices  of  refraction  without  voltage.  An ,  and  A  n2  are  the 
changes  of  n,  and  n2  due  to  EO  effect,  and  An  =  An2  —  An,. 
The  phase  mismatch  of  the  isotropic  AEO  effect  is  very  small 
compared  with  that  of  anisotropic  AEO  effect  because  in  the 
isotropic  case,  n,  =  n2  and  An,  =  An2,  and  hence  0. 
For  the  anistropic  case  we  can  write  An  as  follows2: 

r2)/ 2  ]  V  /h,  (3) 

where  h  is  the  height  of  the  crystal,  V  is  the  applied  voltage, 
and  r,  and  r2  are  EO  coefficients.  We  define  the  voltage  vAEO 
as  a  measure  of  the  electrically  induced  phase  mismatch  in 
the  AEO  effect,  satisfying  the  following: 

(AKL/2)  =  (itV/Vaeo).  (4) 

From  equations  (2)— (4)  we  have 

VAE°~[Ah/L)[\n]r,-n\r2)/2)-'.  (5) 

FAEO  is  approximative^  equal  to  twice  the  half-wave  vol¬ 
tage  of  the  same  crystal  utilized  as  a  transverse  EO  modula¬ 
tor.  We  can  rewrite  ( 1 )  in  terms  of  FAEO  as  follows: 

/rf  =/ini7lsincli,  +  (irF/FAEO)2]''2)2.  (6) 

This  is  the  diffracted  light  intensity  formula  of  the  AEO 
interaction  and  we  can  see  that  this  is  a* direct  effect,  i.e.,  the 
modulation  function  in  Eq.  (6)  is  not  simply  the  product  of 
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FIG.  2.  Photograph  of  the  experimental  device.  The  size  of  the  device  was 
50  mm  x  20  mm  X  20  mm. 

the  electro-optic  and  acousto-optic  effects. 

An  experimental  device  was  constructed  to  demon¬ 
strate  the  AEO  interaction.  The  device,  shown  in  Fig.  2,  was 
constructed  from  a  F-cut  LiNb03  crystal  with  dimensions 
40  X  7  X  12(x  —  y  —  z)  mm.  Two  electrodes  were  evaporated 
on  the  (0,1,0)  surfaces  and  connected  to  a  high  voltage  power 
supply.  An  acoustic  transducer,  mounted  on  the  (1,0,0)  sur¬ 
face,  launches  a  20-MHz,  transverse,  y-polarization,  acous¬ 
tic  wave  in  the  x  direction.  The  device  is  illuminated  with  a 
collimated  beam  from  a  He-Ne  laser,  polarized  in  they  direc¬ 
tion  and  propagating  at  an  angle  1.8  (deg)  (the  Bragg  angle) 
with  respect  to  z  axis.  The  intensity  of  the  diffracted  light  is 
plotted  in  Fig.  3  as  function  of  the  voltage  (normalized  to 
VAEO/v).  The  theoretical  (solid)  curve  is  given  by  Eqs.  (1) 
and  (6).  In  this  experiment  KAEO  was  6  kV  and  77,  the  diffrac¬ 
tion  efficiency,  was  2%.  The  experimental  results  are  in  ex¬ 
cellent  agreement  with  the  theoretical  curve. 

The  simplest  device  that  can  be  implemented  with  the 
AEO  interaction  is  a  light  modulator  in  the  arrangement  of 
the  experiment  discussed  in  the  above  paragraph.  Specifical¬ 
ly  if  the  acoustic  signal  consists  of  a  single  fixed  frequency 
(the  center  frequency  of  the  device)  with  constant  power, 
then  the  diffracted  light  intensity  can  be  modulated  by  vary¬ 
ing  the  applied  voltage  across  the  electrodes  of  the  device,  in 
accordance  to  the  curve  in  Fig.  3-  The  bandwidth  of  the  AEO 
modulator  is  limited  primarily  by  the  maximum  power  sup¬ 
plied  by  the  electrical  dirving  circuit  with  which  the  voltage 
is  applied  across  the  electrodes.  The  voltage  level  required 
for  an  AEO  modulator  is,  within  a  geometrical  factor  close 
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FIG.  4.  Experimental  results  of  a  phase  mismatch  compensated  AEO  de¬ 
flector. 
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to  unity,  twice  that  needed  in  a  transverse  EO  modulator  of 
the  same  geometry.  The  modulated  light  is  angularly  sepa¬ 
rated  from  the  unmodulated  light  and  the  need  for  cross 
polarizers  is  eliminated.  The  AEO  modulator  can  be  operat¬ 
ed  with  unpolarized  light  with  a  loss  of  diffraction  efficiency 
of  2.  The  alignment  of  an  AEO  modulator  (like  an  AO  modu¬ 
lator)  is  almost  insensitive  to  the  direction  perpendicular  to 
the  interaction  plane.  This  is  to  be  compared  to  the  small 
numerical  aperture,  in  both  directions,  of  an  EO  modulator, 
limited  by  natural  birefringence.  The  piezoelectric  trans¬ 
ducer  does  not  affect,  unlike  in  the  AO  case,  the  bandwidth 
of  the  modulator.  Therefore,  it  can  be  designed  to  maximize 
the  diffraction  efficiency  by  increasing  the  transducer  width 
and  thus  the  interaction  length.  In  addition  the  acoustic 
transit  time  limitation  that  is  associated  with  the  AO  modu¬ 
lator  is  not  encountered  here  and  thus  an  extended  collimat¬ 
ed  optical  beam  can  be  modulated.  The  acoustic  port  can  be 
used  to  dynamically  align  the  modulator  in  the  plane  of  the 
interaction,  by  changing  the  center  frequency,  and  to  com¬ 
pensate  for  fluctuations  in  the  optical  input  intensity  by 
changing  the  intensity  of  the  acoustic  power.  We  have  com¬ 
pared  the  linearity  of  the  AEO  and  EO  modulators  by  calcu¬ 
lating  the  modulation  depth  obtained  in  the  two  cases  when 
the  third  harmonic  is  set  to  1%  of  the  fundamental.  The 
modulation  efficiency  is  44%  in  the  AEO  modulator  and 
48%  in  the  EO  modulator. 

AEO  interaction  can  also  be  used  to  improve  the  perfor¬ 
mance  of  an  AO  deflector.  The  numer  of  resolvable  spots  in 
an  AO  deflector  is  given  by 

N  =  AdT/Ad0;  Ad0  =  A/nD,  (7) 
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where  A  d  T  is  the  total  deflected  angle,  A.  is  the  optical  wave¬ 
length,  n  is  the  index  of  refraction,  and  D  is  the  optical  aper¬ 
ture.  AdT  is  limited  by  the  bandwidth  of  the  deflector  and 
determined  by  the  transducer  bandwidth  and  the  phase  mis¬ 
match  introduced  by  the  deviation  of  the  scanning  acoustic 
wave  frequency  from  the  center  frequency.  If  the  appropri¬ 
ate  voltage  is  applied  to  compensate  the  phase  mismatch 
introduced  for  each  scanning  frequency,  a  larger  total  deflec¬ 
tion  angle  and  a  larger  number  of  spots  can  be  obtained.  The 
phase  mismatch  Ak  is  approximately  linear  in  the  applied 
voltage  and  for  small  acoustic  frequency,  which  is  the  case  of 
our  experiment,  it  is  also  linear  in  the  change  of  frequency 
/ —fc.  Therefore,  the  compensating  voltage  is  linear  in  the 
change  of  frequency/— fc .  The  number  of  spots  in  an  AEO 
deflector  neglecting  the  influence  of  the  transducer  band¬ 
width  is  given  by 

N'  =  N(\  +  2.25F„M/rAEO),  (8) 

where  is  the  maximum  voltage  amplitude.  The  device, 
shown  in  Fig.  2,  was  also  used  to  demonstrate  the  AEO  de¬ 
flector.  The  results  of  this  experiment  are  shown  in  Fig.  4. 
The  normalized  intensity  of  the  diffracted  light  obtained 
with  and  without  the  compensating  voltage  is  plotted  as  a 
function  of  the  acoustic  frequency.  The  compensating  vol¬ 
tage,  as  a  function  of  the  acoustic  frequency,  is  plotted  in  the 
same  figure.  From  Fig.  4  we  can  see  that  the  bandwidth  of 
the  AEO  deflector  is  about  2.S  larger  than  that  of  the  AO 
deflector  and  was  limited  by  the  electrical  bandwidth  of  the 
transducer.  The  compensating  voltage  is  approximately 
linear  in /— /r .  If  the  acoustic  frequency  is  sufficiently  high, 
so  that  the  acoustic  wavelength  is  comparable  to  the  optical 
wavelength,  we  have  to  include  a  quadratic  term  in  the  rela¬ 
tion  between  the  phase  mismatch  and  the  frequency  change; 
therefore,  the  compensating  voltage  will  also  include  a  qua¬ 
dratic  term  in  this  case. 

The  research  reported  in  this  paper  was  supported  by 
the  Air  Force  Office  of  Scientific  Research. 
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Photorefractive  materials  have  been  extensively  used  in 
recent  years  as  real-time  recording  media  for  optical  holog¬ 
raphy.1-2  One  prospective  application  of  real-time  holography 
is  in  the  area  of  optical  information  processing;  for  example, 
the  correlation  between  two  mutually  incoherent  images  has 
recently  been  demonstrated  in  real  time  in  a  four-wave  mixing 
geometry.3  Often,  however,  the  information  to  be  processed 
exists  only  in  incoherent  form.  High  performance  spatial  light 
modulators4  are  thus  necessary  in  many  optical  information 
processing  systems  to  convert  incoherent  images  to  coherent 
replicas  for  subsequent  processing.  We  report  in  this  Com¬ 
munication  the  successful  demonstration  of  real-time  inco- 
herent-to-coherent  image  transduction  through  the  use  of 
holographic  recording  in  photorefractive  crystals.  Several 
possible  configurations  and  experimental  results  are  pre¬ 
sented. 

The  interference  of  two  coherent  beams  in  the  volume  of 
a  photorefractive  crystal  generates  nonuniformly  distributed 
free  carriers,  which  are  redistributed  spatially  by  diffusion 
and/or  drift  in  an  external  applied  Field.  The  subsequent 
trapping  of  the  free  carriers  in  relatively  immobile  trapping 
sites  results  in  a  stored  space-charge  Field,  which  in  turn 
modulates  the  index  of  refraction  through  the  linear  elec¬ 
trooptic  effect.6  Thus  a  volume  phase  hologram  is  recorded. 
If  the  two  coherent  beams  are  plane  waves,  a  uniform  phase 
grating  is  established.  An  incoherent  image  focused  in  the 
volume  of  the  photorefractive  material  will  spatially  modulate 
the  charge  distribution  stored  in  the  crystal.  This  spatial 
modulation  can  be  transferred  onto  a  coherent  beam  by  re¬ 
constructing  the  holographic  grating.  The  spatial  modulation 
of  the  coherent  reconstructed  beam  will  then  be  a  negative 
replica  of  the  input  incoherent  image.  The  holographic 
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Fig.  1.  Experimental  setup  for  incoherent-to-coherent  conversion 
with  phase  conjugation  in  four- wave  mixing.  The  writing  beams  I\ 
and  1 2  and  the  reading  beam  h  are  generated  from  an  argon  laser  ( A 
«  514  nm).  The  phase  conjugate  beam  /4  is  diffracted  at  the  same 
wavelength.  The  transparency  T(x,y)  is  illuminated  with  a  xenon 
arc  lamp  S  and  imaged  on  the  BSO  crystal  with  the  optical  system  L  i 
through  a  filter  F(  A  »  545  nm).  BS  is  a  beam  splitter,  and  P  is  a  po¬ 
larizer  placed  in  the  output  plane. 


(a) 


Fig.  3.  Photorefractive  incoherent-to-coherent  conversion  of  a 
transparency  with  grey  levels. 


Fig.  4.  Fourier  transform  of  a  grid  pattern  formed  after  a  photore¬ 
fractive  incoherent-to-coherent  conversion  of  the  grid  pattern  pattern 
image. 


(b) 

Fig.  2.  Incoherent-to-coherent  conversion  utilizing  phase  conjugation 
in  four-wave  mixing:  (a)  spoke  target:  (b)  USAF  resolution  target. 
The  group  3.6,  corresponding  to  a  resolution  of  14.3  Ip/mm,  is  well 
resolved. 


grating  can  be  recorded  before,  during,  or  after  the  crystal  is 
exposed  to  the  incoherent  image.  Therefore,  a  number  of 
operating  modes  are  possible.  These  include  the  Grating 
Erasure  Mode  (GEM),  the  Grating  Inhibition  Mode  (GIM), 
and  the  Simultaneous  Erasure  Writing  Mode  (SEWM), 
among  others. 

In  the  Grating  Erasure  Mode,  a  uniform  grating  is  recorded 
by  interfering  the  two  writing  beams  in  the  photorefractive 
crystal.  This  gTating  is  then  selectively  erased  by  incoherent 
illumination  of  the  crystal  with  an  image-bearing  beam.  The 
incoherent  image  may  be  incident  either  on  the  same  face  of 
the  crystal  as  the  writing  beams  or  on  the  opposite  face. 
When  the  absorption  coefficients  of  the  writing  and  image¬ 
bearing  beams  give  rise  to  significant  depth  nonuniformity 
within  the  crystal,  these  two  cases  will  have  distinct  wave¬ 
length-matching  conditions  for  response  optimization. 

In  the  Grating  Inhibition  Mode,  the  crystal  is  pre- illuminated 
with  the  incoherent  image-bearing  beam  prior  to  grating 
formation.  This  serves  to  selectively  decay  (enhance)  the 
applied  transverse  electric  field  in  exposed  (unexposed)  re¬ 
gions  of  the  crystal.  After  this  pre-exposure,  the  writing  beams 
are  then  allowed  to  interfere  within  the  crystal,  causing  grating 
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formation  with  spatially  varying  efficiency  due  to  vast  dif¬ 
ferences  in  the  local  effective  applied  field.  This  technique 
will  also  work  in  the  diffusion  limit  with  no  external  applied 
field  by  means  of  a  similar  physical  mechanism. 

In  the  Simultaneous  Erasure  Writing  Mode,  the  conventional 
degenerate  four-wave  mixing  geometry  is  modified  to  include 
simultaneous  exposure  by  an  incoherent  image-bearing  beam, 
as  shown  schematically  in  Fig.  1.  Diffraction  by  a  phase 
grating  in  the  four- wave  mixing  configuration  has  been 
modeled  following  two  different  approaches.6  7  Common  to 
both  analyses,  the  diffracted  intensity  is  proportional  to  both 
the  readout  intensity  and  the  square  of  an  effective  modula¬ 
tion  ratio,  in  the  first-order  approximation,  and  assuming  no 
pump  depletion.  In  addition,  a  uniform  beam  incident  on  the 
photosensitive  medium  at  an  arbitrary  angle  decreases  the 
modulation  ratio  and  hence  the  overall  diffraction  efficiency* 
In  the  SEWM  configuration,  these  effects  can  be  combined 
with  the  diffraction  of  a  conjugate  beam  in  a  four-wave  mixing 
geometry  to  perform  the  incoherent-to-coherent  image  con¬ 
version.  In  particular,  this  conversion  can  be  regarded  as 
caused  by  selective  spatial  modulation  of  the  grating  by  spatial 
encoding  of  the  incoherent  erasure  beam.  It  should  be  noted 
here  that  a  related  image  encoding  process  could  be  imple¬ 
mented  in  a  nonholographic  manner  by  premultiplication  of 
the  image  with  a  grating.9 

In  our  experiments,  we  have  successfully  produced  inco¬ 
herent-to-coherent  conversions  in  all  three  operating  mode 
configurations  as  well  as  in  several  modifications  of  the  basic 
arrangements  described  above.  We  present  here  experi¬ 
mental  results  from  our  implementations  of  the  Simultaneous 
Erasure  W'riting  Mode. 

The  experimental  arrangement  in  one  implementation  is 
as  shown  in  Fig.  1.  The  two  plane  wave  writing  beams  (la¬ 
beled  / 1  and  /2)  are  generated  from  an  argon  laser  (X  =  514 
nm)  and  interfere  inside  the  photorefractive  crystal  to  create 
a  phase  volume  hologram.  The  readout  beam  /3,  collinear 
with  /,  to  satisfy  the  Bragg  condition,  diffracts  the  phase 
conjugate  beam  f4  at  the  same  wavelength  and  with  increased 
diffraction  efficiency  when  a  transverse  electric  field  is  applied 
to  the  electrooptic  medium.  An  incoherently  illuminated 
transparency  T(x,y )  with  intensity  f,(x,y)  (either  quasi- 
monochromatic  or  white  light)  is  imaged  in  the  plane  of  the 
crystal.  The  beam  splitter  BS  separates  the  diffracted  signal 
from  the  writing  beam;  the  Polaroid  filter  P  in  the  output 
plane  eliminates  the  unwanted  scattered  light  to  enhance  the 
signal -to-noise  ratio.10  The  photorefractive  material  utilized 
was  a  single  crystal  of  bismuth  silicon  oxide  (BSO),  cut  to 
expose  polished  ( 1 10)  faces,  and  of  dimensions  7.3  X  6.9  X  1.3 
mm1. 

A  transverse  electric  field  E 0*4  kV/cm  was  applied  along 
the  [IlOj  axis  perpendicular  to  the  polished  faces.  The  carrier 
frequency  of  the  holographic  grating,  f  -  300  lp/mm,  was 
within  the  optimum  range  for  the  drift-aided  charge  transport 
process. 1 1  The  vertically  polarized  coherent  writing  beam  and 
signal  intensities  were  1\,2~  0.4  mW/cm2  and  /,  =  8  mW/cm2, 
respectively.  Figure  2  shows  the  converted  images  obtained 
from  two  binary  transparencies  (a  spoke  target  and  a  USAF 
resolution  target).  The  illumination  was  provided  by  a  xenon 
arc  lamp  through  a  broadband  filter  centered  at  X  ■  545  nm 
(FWHM  *  100  nm).  An  approximate  resolution  of  15  lp/mm 
was  achieved  without  optimizing  factors  such  as  the  optical 
properties  and  quality  of  the  crystal,  the  depth  of  focus  in  the 
bulk  of  the  medium,  the  carrier  frequency  of  the  grating,  and 
the  relative  intensities  and  wavelengths  of  the  various  beams. 
This  spatial  bandwidth  is  comparable  with  that  obtained  with 
a  PROM12  or  a  liquid  crystal  light  valve.13 

The  image  shown  in  Fig.  3  demonstrates  the  capability  of 


the  technique  to  reproduce  many  grey  levels.  To  obtain  this 
image,  a  negative  transparency  was  illuminated  with  blue  light 
(X  *  488  nm)  derived  from  an  argon  laser  and  was  focused  on 
the  BSO  crystal.  The  holographic  grating  was  recorded  with 
green  light  (X  «  514  nm)  and  read  out  with  an  auxiliary  red 
beam  (X  *  6328  A). 

The  2-D  Fourier  transform  formed  by  a  lens  after  the  in- 
coherent-to-coherent  conversion  of  a  grid  pattern  is  shown  in 
Fig.  4.  The  fundamental  spatial  frequency  of  the  grid  was  ~1 
lp/mm.  The  existence  of  several  diffracted  orders  and  the 
well-focused  diffraction  pattern  are  positive  indications  that 
the  device  is  suitable  for  coherent  optical-  processing  opera¬ 
tions. 

Although  these  results  are  preliminary,  they  clearly  dem¬ 
onstrate  the  feasibility  of  real-time  incoherent-to-coherent 
conversion  utilizing  phase  conjugation  in  photorefractive  BSO 
crystals.  This  device  has  potential  for  incoherent-to-coherent 
conversion  with  high  resolution,  which  can  be  realized  by 
optimizing  the  optical  properties  and  quality  of  the  crystal, 
the  depth  of  focus  in  the  bulk  of  the  medium,  the  carrier  fre¬ 
quency  of  the  grating,  and  the  relative  intensities  and  wave¬ 
lengths  of  the  various  beams.  In  addition,  such  a  device  is 
quite  attractive  from  considerations  of  low  cost,  ease  of  fab¬ 
rication,  and  broad  availability.  With  such  a  device,  nu¬ 
merous  optical  processing  functions  can  be  directly  imple¬ 
mented  that  utilize  the  flexibility  afforded  by  the  simulta¬ 
neous  availability  of  incoherent-to-coherent  conversion  and 
volume  holographic  storage. 
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Abstract  Volume  holographic  storage  in  photorefractive  Bi^SO^IBSO)  crys¬ 
tals  is  utilizedto  perform  dynamic  incoherent-to- coherent  image  conversion  by 
means  of  selective  spatial  erasure  of  a  uniform  grating  with  white  (or  quasi- 
monochromatic)  light.  Physical  characterization  of  device  performance  is  de¬ 
scribed.  with  emphasis  on  resolution,  sensitivity,  and  temporal  response.  The 
photorefractive  irvcoherent-to- coherent  optical  conversion  process  is  analyzed 
in  terms  of  a  simple  model  that  relates  the  diffracted  intensity  to  the  space- 
variant  effective  modulation  ratio. 
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1.  INTRODUCTION 

Real-time  holography  in  photorefractive  materials  has  been  utilized 
for  many  applications  in  the  areas  of  optical  processing,1  nondestruc¬ 
tive  testing  of  vibrating  structures,2  and  image  propagation  through 
aberrating  media.’  In  addition,  the  development  of  high  perfor¬ 
mance  spatial  light  modulators  has  received  much  recent  attention, 
primarily  for  incoherent-to-coherent  conversion  functions  in  optical 
information  processing  and  computing  applications.0  We  have  pre¬ 
viously  reported*  the  successful  application  of  volume  phase  holog¬ 
raphy  to  the  real-time  conversion  of  an  incoherent  image  (quasi- 
monochromatic  or  white-light  illumination)  into  a  coherent  replica. 
Several  possible  configurations  for  the  performance  of  this  image 
transduction  in  photorefractive  materials  were  discussed  therein. 
Such  a  conversion  process  has  also  been  investigated  independently.'’ 

In  this  paper,  we  present  a  simple  model  that  describes  the  in¬ 
coherent-to-coherent  conversion  process  in  terms  of  the  space- 
variant  effective  modulation  ratio.  The  model  is  shown  to 
satisfactorily  explain  the  principal  features  of  the  device  sensi- 
tometry  behavior.  The  limiting  resolution  of  the  process  is  discussed, 
and  geometric,  systemic,  and  materials-related  constraints  are  identi¬ 
fied.  Experimental  measurements  of  the  device  temporal  response 
characteristics  are  presented. 

Invited  Paper  IP-107  received  July  3.  1914;  revised  manuicnpi  received  Oci  I.  I9S4. 
accepted  for  publication  Oct.  9,  1984.  received  by  Managing  Editor  Oci  II.  1984  Thu 
paper  it  a  revision  of  Paper  465-12  which  was  presented  at  the  SPIE  conference  on 
Spatial  Light  Modulators  and  Applications.  Jan.  26-22.  1984.  Los  Angeles.  CA  The 
paper  presented  there  appeart  < unrefereed)  in  SPIE  Proceedings  Vol  465 
•  1985  Society  of  Photo-Optical  Instrumentation  Engineers. 


The  high  sensitivity  of  photoconductive  and  electrooptic  crystals 
such  as  bismuth  silicon  oxide  (Bil2SiO20,  or  BSO)  in  the  visible 
spectrum  has  allowed  the  simultaneous  recording  and  reading  of 
volume  holograms  to  be  achieved  with  time  constants  amenable  to 
real-time  operation.  The  holographic  recording  process  in  photore¬ 
fractive  materials  involves  photoexcitation,  charge  transport,  and 
trapping  mechanisms.*-9  When  two  coherent  beams  are  allowed  to 
interfere  within  the  volume  of  such  a  crystal,  free  carriers  are  nonuni- 
formly  generated  by  absorption  and  are  redistributed  by  diffusion 
and/or  drift  under  the  influence  of  an  externally  applied  electric 
field.  Subsequent  trapping  of  these  charges  generates  a  stored  space- 
charge  field,  which  in  turn  modulates  the  refractive  index  through 
the  linear  electrooptic  (Pockels)  effect  and  thus  records  a  volume 
phase  hologram.  If  both  coherent  writing  beams  are  plane  waves,  the 
induced  hologram  will  consist  of  a  uniform  grating. 

In  the  photorefractive  incoherent-to-coherent  optical  conversion 
(PICOC)  process,  in  addition  to  the  uniform  holographically 
induced  grating  stored  in  the  crystal,  an  incoherent  image  is  focused 
in  the  volume  of  the  photorefractive  material  and  creates  a  spatial 
modulation  that  can  be  transferred  onto  a  coherent  readout  beam  by 
reconstructing  the  holographic  grating.  The  spatial  modulation  of 
the  coherent  reconstructed  beam  will  then  be  a  negative  replica  of  the 
input  incoherent  image.  The  holographic  grating  can  be  recorded 
before,  during,  or  after  the  crystal  is  exposed  to  the  incoherent  image. 
Therefore,  a  number  of  distinct  operating  modes  are  possible,  includ¬ 
ing,  among  others,  the  grating  erasure  mode  (GEM),  the  grating 
inhibition  mode  (GIM),  and  the  simultaneous  erasure/  writing  mode 
(SEWM). 

In  the  grating  erasure  mode,  a  uniform  grating  is  first  recorded  by 
interfering  the  two  coherent  writing  beams  in  the  photorefractive 
crystal.  This  grating  is  then  selectively  erased  by  incoherent  illumina¬ 
tion  of  'he  crystal  with  an  image-bearing  beam.  The  incoherent 
image  may  be  incident  either  on  the  same  face  of  the  crystal  as  the 
writing  beams  or  on  the  opposite  face.  When  the  absorption  coeffi¬ 
cients  at  the  writing  and  image-bearing  beam  wavelengths  give  rise  to 
significant  depth  nonuniformity  within  the  crystal,  these  two  cases 
will  have  distinct  wavelength- matching  conditions  for  response 
optimization. 

In  the  grating  inhibition  mode,  the  crystal  is  illuminated  with  the 
incoherent  image-bearing  beam  prior  to  grating  formation.  This 
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Fig.  1 .  Experimental  configuration  for  photorofractlvo  incoherant-to- 
oohorant  optical  eonworeionIPICOCHntho  *imuttanaou*  traaura/ writing 
mode.  The  writing  boom*  I,  and  I*  and  the  reading  beam  lj  are  ganaratad 
from  an  argon  laaar  (A  •  614  nm).  The  pbaaa  conjugate  beam  I4  i*  dif¬ 
fracted  at  the  aama  wavelength.  The  tranaparancyT(x,y)iailluminatad  with 
a  xenon  arc  lamp  S  and  imagad  onto  the  BliiSiOjo  ayatal  with  the  optical 
eyatem  L,  through  a  fUtar  F  ( A  «  646  nm|.  A  coherent  rapMca  la  formed  in 
the  output  plana  by  utilizing  baam  apNttar  66  in  conjunction  with  Iona  Lj  to 
image  tha  aurfaca  of  tha  cryatal  onto  tha  output  plana  through  poiariur  P. 


■  serves  to  selectively  decay  ( or  enhance)  the  applied  transverse  electric 

)  field  in  exposed  (or  unexposed)  regions  of  the  crystal.  After  the 

1  incoherent  exposure,  the  coherent  writing  beams  are  then  allowed  to 

'  interfere  within  the  crystal,  causing  grating  formation  with  spatially 
I  varying  efficiency  due  to  significant  differences  in  the  local  effective 
j  applied  field. 

I  In  the  simultaneous  erasure /  writing  mode,  the  incoherent  image 

1  modulation,  the  coherent  grating  formation  process,  and  the  readout 

function  are  performed  simultaneously.  In  one  possible  implementa¬ 
tion  of  this  mode,  the  conventional  degenerate  four-wave  mixing 
geometry  can  be  modified  to  include  simultaneous  exposure  by  an 
incoherent  image-bearing  illumination,  as  shown  schematically  in 
Fig.  I .  In  this  configuration,  the  coherent  replica  of  the  incoherently 

(exposed  image  appears  in  the  conjugate  diffracted  beam. 

The  PICOC  process  thus  can  be  regarded  as  being  caused  by 
selective  spatial  modulation  of  a  grating  by  spatial  encoding  of  an 
[  incoherent  erasure  beam.  It  should  be  noted  here  that  a  related  image 
,  encoding  process  could  be  implemented  in  a  nonholographic  manner 

■  by  premultiplication  of  the  image  with  a  grating.10 

m 

-  2.  PHOTOREFRACTIVE  INCOHERENT-TO- 

1  COHERENT  OPTICAL  CONVERTER 

L  2.1.  Principles  of  operation 

J  The  three  operating  modes  described  above  exhibit  significant  dif- 
«  ferences  with  respect  to  sensitivity,  response  time,  contrast  ratio,  and 
•  operational  complexity.  Of  these,  the  simultaneous  erasure/  writing 

-  mode  offers  the  highest  degree  of  operational  simplicity  due  to  its 

I  inherent  nondestructive  readout  capability  and  its  lack  of  beam 

'  sequencing  requirements.  In  the  remainder  of  this  paper,  this  mode  is 

‘  described  in  more  detail  as  an  example  of  the  essential  features  of 

■,  PICOC  device  operation.  Extension  of  the  model  to  the  grating 

'•  erasure  mode  and  grating  inhibition  mode  can  be  made  by  proper 

incorporation  of  sequencing  time  constants.  As  a  specific  example  of 
s  the  simultaneous  erasure/  writing  mode,  we  will  discuss  the  config- 

t  uration  in  which  the  coherent  writing  beams  and  the  incoherent 

^  image-bearing  beam  illuminate  the  same  face  of  a  BSO  photorefrac- 

tive  crystal,  with  a  transverse  electric  field  applied  along  the  <  i  I0> 
axis,  as  shown  in  Fig.  2. 

Consider  the  incident  intensity  distribution  to  be  composed  of 
■>  two  coherent  writing  beams  with  intensities  I  ( and  T,  and  an  incoher¬ 

ent  signal  beam  with  intensity  Is(x)  at  the  surface  of  the  crystal.  The 

| 


Fig.  2.  PICOC  trantvaraa  alaetrooptie  configuration  and  recording  goomo- 
try.  Tha  volume  holographic  grating  with  wave  vector  i*  formed  by  tha 
coherent  writing  beam*  I,  and  I},  and  tha  incoherent  information  i* 
encoded  on  tha  baam  l«. 


coherent  writing  beams  will  combine  to  form  an  interference  pattern 
IG(x)  such  that  the  total  incident  intensity  distribution  [I-^x)]  can  be 
written  as 

Mx)  =  lG(x)  +  ls(x) 

=  IqO  +  niQ  cosKgx)  +  Is(l  +  mg  cosKsx)  ,  (I) 

where  lG  —  I,  +  12  and  mG  =  2(1, 1,)1-^/ Ic,  Kc  and  Ks  are  the 
wave  vectors  of  the  coherent  grating  (G)  and  a  particular  harmonic 
component  of  the  incoherent  image  (S),  and  mG  and  1x15  are  the 
respective  modulation  ratios.  Due  to  the  nonlinear  dependence  of  the 
induced  space -charge  field  on  the  incident  intensity,  such  a  distribu¬ 
tion  will  generate  a  refractive  index  modulation  that  can  be  written  in 
the  form 

An(x)  =  C'CosKqX  +  CjCosKsx  +  C3cos[(KG  —  K.s)x] 

+  C^cos^ICq  +  Ks)x]  +  other  terms.  (2) 

Note  in  particular  that  An( x)  contains  the  sum  and  difference  spatial 
frequencies  as  well  as  the  fundamental  harmonics.  The  constants 
Cj  (i  =  I  to  4)  represent  the  amplitudes  of  each  frequency  compo¬ 
nent.  Thus,  the  far-field  diffraction  pattern  shown  in  Fig.  3  will 
comprise  several  beams,  each  corresponding  to  a  specific  term  in  the 
refractive  index  modulation. 

To  demonstrate  incoherent-to-coherent  conversion  in  the  four- 
wave  mixing  configuration,  the  experimental  arrangement  of  Fig.  I 
was  utilized  with  a  1 .3  mm  thick  (110)  cut  BSO  crystal.  A  transverse 
electric  field  (£5  =  4  kV/cm)  was  applied  along  the  <  Jl0>  axis, 
and  the  carrier  frequency  of  the  holographic  grating  (f  =  300  line 
pairs/ mm)  was  chosen  to  lie  within  the  optimum  range  for  drift- 
aided  charge  transport  in  BSO." 

In  this  implementation,  the  two  plane  wave  writing  beams 
(labeled  I(  and  l2  in  Fig.  I)  are  generated  from  an  argon  laser 
(Aq  =  514  nm)  and  interfere  inside  the  BSO  crystal  to  create  a 
volume  phase  hologram.  The  readout  beam  l3,  collinear  with  1,  to 
satisfy  the  Bragg  condition,  is  diffracted  to  form  the  phase  conjugate 
beam  14  at  the  same  wavelength.  Increased  diffraction  efficiency 
results  when  a  transverse  electric  field  is  applied  to  the  electrooptic 
medium.  An  incoherently  illuminated  transparency  T(x,y).  with 
intensity  Is  (x,y)  (either  quasi-monochromatic  or  white  light),  is 
imaged  in  the  plane  of  the  crystal.  The  beam  splitter  BS  separates  the 
diffracted  signal  from  the  writing  beam,  and  the  polarizing  filter  P  in 
the  output  plane  eliminates  the  unwanted  scattered  light  to  enhance 
the  signal-to-noise-ratio."  The  vertically  polarized  coherent  writing 
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Fig.  4.  Photorafractiva  mcoharant-to-coharant  optical  convanion  of  two 
binary  tranaparanciaa:  (a)  apofca  targat  and  (b)  U.S.  Air  Forca  raaolution 
targat. 


CASE  I:  od<  1 


1  A  nF* 
(W/2)  1  d 


EXAMPLE:  FOR  n  =  2.5,  d  =  1mm,  F#  =  5, 


R  =  50  line  poirs/mm 


Fig.  (.  Gaomatric  constraints  imposed  on  PICOC  raaolution  by  tha  finite 
f- number  of  the  input  optics  for  tha  case  ad  <  1 


EXAMPLE:  FOR  n  =  2.5,  d=1mm,  F#*5,  oMOOcirf' 
R  *  500  line  poirs/mm 


Fig.  7.  Gaomatric  constraints  imposed  on  PICOC  raaolution  by  tha  finite 
f- number  of  tha  input  optics  for  tha  case  srd  » 1 . 


Fig.  5.  Phot  or efr active  incoharant-to-coharam  optical  conversion  of  a 
grey- level  transparency. 


beam  and  signal  intensities  were  1,  2  =  0.4  mW/cm2  and  Is  = 
8  mW/cm2,  respectively.  The  incoherent  illumination  was  provided 
by  a  xenon  arc  lamp  through  a  broadband  Alter  centered  at 
As  =  545  nm  (FWHM  =  100  nm). 


The  converted  images  obtained  from  two  binary  transparencies  (a 
spoke  target  and  a  U.S.  Air  Force  resolution  target)  and  from  a 
black-and-white  slide  with  gray  levels  are  shown  in  Figs.  4  and  5, 
respectively.  The  original  transparency  and  its  converted  image  have 
reversed  contrast.  An  approximate  resolution  of  15  line  pairs/ mm 
(as  derived  from  the  resolution  target  image)  was  achieved  without 
optimizing  factors  such  as  the  optical  properties  and  quality  of  the 
crystal,  the  depth  of  focus  in  the  bulk  of  the  medium,  the  carrier 
frequency  of  the  grating,  the  relative  intensities  and  wavelengths  of 
the  various  beams,  or  the  Bragg  diffraction  condition  (discussed 
below).  This  spatial  bandwidth  is  comparable  to  that  obtained  with  a 
Pockels  Readout  Optical  Modulator13  or  a  liquid  crystal 
light  valve.14 

22.  Device  resolution  considerations 

A  number  of  distinct  factors  influence  the  ultimate  resolution 
achievable  with  the  PICOC  spatial  light  modulator.  These  factors 
can  be  classified  as  geometric,  systemic,  or  materials-related  in 
nature  and  are  described  in  detail  below. 

Geometric  resolution  limitations  derive  principally  from  the 
incorporation  of  an  incoherent  imaging  system  in  the  four-wave 
mixing  gometry  and  from  the  finite  crystal  thickness  required  to 
create  a  volume  holographic  grating  These  effects  are  illustrated  in 
Figs.  6  and  7.  Figure  6  describes  the  case  for  which  acd<<  I  at  the 
grating  recording  wavelength,  such  that  the  induced  holographic 
grating  has  essentially  uniform  amplitude  throughout  the  volume  of 
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Ronchi-Ruling 

Fourier  Transform 

5  Ip/mm 

Fig.  8.  Coherent  replica  images  and  corresponding  Fourier  transforms  of  a 
6  line  pai rs/mm  Ronchi  ruling  after  photorefractive  incoherent-to- 
coherent  conversion.  In  the  upper  case  Kg  end  K,  are  perpendicular,  swhere- 
aa  in  the  lower  caae  Kg  and  K<_  are  parallel. 


the  crystal.  As  can  be  seen  from  the  figure,  the  optimum  focal  point 
occurs  in  the  volume  of  the  crystal  (in  the  center  when  in  addition 
Ojd  « 1 )  and  is  not  localized  on  the  front  surface  of  the  crystal.  The 
resolution  will  then  be  proportional  to  (W/2)-1,  which  is  in  turn 
equal  to  4nF#/  d,  where  n  is  the  refractive  index  of  the  electrooptic 
crystal,  F#  is  the  f-number  of  the  input  incoherent  imaging  system 
(assumed  1:1),  d  is  the  crystal  thickness,  and  aG  and  as  are  the 
absorption  coefficients  at  the  grating  and  signal  wavelengths  (  Kq 
and  Xj),  respectively.  For  example,  for  n  =  2.5,  d  =  I  mm,  and  an 
f-number  of  5,  the  resolution  limit  is  approximately  50  line  pairs/  mm. 
Figure  7  describes  the  case  for  which  aGd  » 1 ,  such  that  the  induced 
holographic  grating  has  significant  amplitude  only  within  a  thin 
layer  of  thickness  deff  =  aG-1.  In  this  case,  the  resolution  will  be 
given  by  4nF#aG.  For  n  =  2.5, d  =  1  mm,  aG  =  100cm-1, andan 
f-number  of  5,  the  resolution  limit  is  approximately  500  line 
pairs/  mm.  It  should  be  noted  that  if  the  absorption  coefficient  as  is 
chosen  to  be  significantly  larger  than  aG,  the  resolution  will  be 
constrained  by  <*$  instead  of 

Several  systemic  resolution  constraints  derive  from  the  utilization 
of  a  volume  hologram  in  the  image  conversion  process.  One  such 
constraint  is  that  the  coherent  grating  spatial  frequency  must  be 
significantly  larger  than  the  signal  (incoherent  image)  bandwidth  in 
order  to  effect  separation  of  the  diffracted  beam  components,  due  to 
harmonic  generation  that  occurs  simultaneously  around  the  zeroth 
and  first  orders  of  the  carrier  grating.  In  addition,  the  range  of  spatial 
frequencies  distributed  about  the  coherent  grating  spatial  frequency 
should  be  in  an  optimum  region  of  the  modulation  transfer  charac¬ 
teristic  of  the  device. 

A  third  fundamental  systemic  constraint  on  PICOC  device  reso¬ 
lution  derives  from  Bragg  detuning  effects  associated  directly  with 
the  use  of  a  volume  hologram.  This  effect  is  strikingly  illustrated  in 
Fig.  8,  which  comprises  convened  images  of  a  5  line  pair/  mm  Ronchi 
ruling  and  their  related  coherent  Fourier  transforms  for  two  orthog¬ 
onal  orientations  of  the  incoherent  grating  wave  vector  relative  to  the 
coherent  grating  wave  vector.  As  can  be  seen. from  the  figure,  a 
significant  difference  in  resolution  exists  between  cases  in  which  the 
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Fig.  9 .  Wave  vector  diagram  o<  tha  PICOC  procaaa  for  the  case  of  collin- 
aar  aignal  (Ks)  and  grating  (Kg)  wave  vector*.  Readout  with  a  beam 
incident  at  wave  vector  k3  reautta  in  diffracted  beam*  at  k«4  and  k«_.  with 
corresponding  Bragg  mismatches  AK+  and  AK_  Tha  grating  wave  vector 
Kg  is  related  to  tha  wave  vectors  k,  and  kj  of  tha  coherent  writing  beams 
by  I  Kg  I  *=  21  k,  I  sind  =  21  k2l  Sind. 


Fig.  10.  Wav*  vector  diagram  of  tha  PICOC  procaas  for  tha  casa  in  which 
tha  signal  wave  vector  is  tangent  to  tha  equiphase  circle.  Readout  with  a 
beam  incident  at  wave  vector  k2  results  in  diffracted  beams  at  k««  and  k*_. 
with  significantly  reduced  Bragg  mismatches  Alt*  and  AK_. 


wave  vector  of  the  ruling  (incoherent  grating)  is  parallel  or  perpen¬ 
dicular  to  the  coherently  written  (holographic)  grating  This  differ¬ 
ence  derives  principally  from  the  fact  that  a  different  wave  vector 
matching  condition  exists  for  these  two  cases,  as  shown  in  Figs.  9  and 
10.  In  Fig.  9,  the  incoherent  grating  wave  vector  is  parallel  to  the 
coherent  grating  wave  vector,  a  condition  achieved  by  symmetrically 
disposing  the  incident  coherent  beams  about  the  normal  to  the 
crystal  while  simultaneously  arranging  the  incoherent  imaging  sys¬ 
tem  such  that  its  optical  axis  is  parallel  to  the  crystal  normal  In  this 
case,  significant  Bragg  detuning  occurs  for  even  small  incoherent 
grating  wave  vectors  (resulting  in  angular  deviations  of  the  diffracted 
beam).  In  Fig.  10,  the  incoherent  grating  wave  vector  is  arranged  to 
lie  tangent  to  the  circle  defined  by  the  incident  coherent  grating  wave 
vectors,  such  that  a  significantly  increased  angular  deviation  of  the 
diffracted  beam  is  allowed  before  significant  Bragg  detuning  effects 
occur.  Such  a  wave  vector  tangency  condition  is  automatically  satis¬ 
fied  when  the  incoherent  grating  wave  vector  is  normal  to  the  coher¬ 
ent  grating  wave  vector  (as  it  is  in  the  orientation  normal  to  the  plane 
of  incidence).  For  the  arrangement  described  in  Fig.  10.  wave  vector 
tangency  is  assured  for  both  orientations,  so  that  the  horizontal  and 
vertical  resolutions  become  degenerate.  This  is  not  the  case  for  the 
situation  depicted  in  Fig.  9,  which  explains  the  observations  noted  in 
Fig.  8.  An  equivalent  condition  is  described  in  Ref.  7  for  the  case  of 
distinct  reading  and  writing  beam  wavelengths. 

A  fourth  related  systemic  constraint  involves  the  trade-off 
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between  saturation  diffraction  efficiency  and  achievable  resolution 
due  to  grating  thickness.  Within  limits,  increases  in  grating  thickness 
increase  the  diffraction  efficiency,  but  at  the  same  time  increase  the 
Bragg  detuning  effects.  This  condition  creates  a  familiar  resolution/ 
sensitivity  trade-off  situation  in  which  one  can  be  optimized  at  the 
expense  of  the  other. 

Additional  resolution  limitations  derive  from  material-dependent 
parameter  constraints  that  influence  the  physics  of  grating  forma¬ 
tion.  This  limitation  is  essentially  described  by  the  behavior  of  the 
diffraction  efficiency  as  a  function  of  the  spatial  frequency  with  the 
applied  transverse  electric  field  as  a  parameter."  The  amplitude 
modulation  transfer  function  of  the  grating  itself  depends  on  the 
spatial  frequency  dependence  of  the  maximum  space-charge  field, 
which  in  turn  depends  on  carrier  mobilities  and  lifetimes,  the  applied 
field,  the  nature  and  distribution  of  traps  in  the  crystal,  and  the  trap 
occupancy  (Fermi)  level. 

Optimization  of  the  PICOC  device  resolution  necessarily  involves 
simultaneous  satisfaction  of  all  three  types  of  constraints,  and  must 
be  undertaken  also  in  compromise  with  factors  that  directly  affect 
the  device  sensitivity.  In  the  following  section,  we  present  a  model 
that  allows  the  device  sensitivity  to  be  understood  and  optimized. 

2  J.  Theoretical  model 

The  following  simple  model  describes  the  encoding  of  the  incoherent 
information  onto  the  coherent  diffracted  beam  by  taking  into 
account  only  the  effective  modulation  ratio  of  the  exposure  in  the 
bulk  of  the  photorefractive  material.  The  different  intensities  inci¬ 
dent  on  the  crystal  are  as  shown  in  Fig.  2.  The  intensity  pattern 
resulting  from  simultaneous  illumination  with  the  coherent  writing 
beams  and  the  incoherent  image-bearing  beam  is  given  by  Eq.  (I), 
which  describes  the  case  of  a  one-dimensional  incoherent  sinusoidal 
grating  with  a  fundamental  component  at  wave  vector  Ks.  The 
space-charge  field  E^  is  related  to  the  current  density  J(x,t)  and  the 
free-carrier  concentration  n(x,t)  through  the  following  system  of 
equations": 

Current  density  equation: 

.  3n(x,t) 

J(x.t)  =  eD  — — - h  epn(x.t)  [E^fx.t)  +  Eq]  ;  (3) 

Continuity  equation: 

dn(x.t)  n(x,t)  —  nd  I  dJ(x.l) 

— —  =  g(x) - +  -— - ;  (4) 


Maxwell's  equation  (integral  form): 


g(x)  =  — - 1G(1  +  mcCosKcxJexpl-OGd) 

<*sf 

+  — -  Is(l  +  mscosK.sx)exp(— osd)  , 


in  which  d  is  the  crystal  thickness  and  the  intensity  absorption 
coefficients  are  os  at  ^  and  ac  at  Kq.  Since  free-carrier  redistribu¬ 
tion  will  occur  both  by  drift  and  diffusion,  the  resultant  space-charge 
field  will  depend  on  both  the  carrier  concentration  n(x)  and  its  spatial 
gradient  3n//)x.  Analytic  solution  of  this  system  of  equations  is 
extremely  complicated  in  general  and  must  be  accomplished  in  the 
context  of  boundary  conditions  applicable  to  a  given  experimental 
situation.  In  the  development  that  follows,  several  simplifying 
assumptions  are  made  that  are  appropriate  for  the  simultaneous 
erasure/  writing  mode  configuration  in  the  steady  state  and  in  the 
large  transverse  applied  field  limit  (characterized  by  enhanced  satu¬ 
ration  diffraction  efficiency). 

In  the  saturation  regime  (steady  state),  the  current  density  is 
constant  and  the  carrier  concentration  is  given  by 

n(x)  =  nd  +  rg(x)  ,  (8) 

in  which  the  free-carrier  lifetime  r  is  assumed  to  be  the  same  for  the 
writing  and  the  erasure  beams  and  to  be  unaffected  by  the  presence  or 
absence  of  illumination.  In  the  strong  drift  regime  for  which  the 
applied  field  is  much  larger  than  the  diffusion  field  (E0>>ED: 
Ed  —  KkBT/e),  solution  of  the  system  of  equations  [Eqs.  (3) 
through  (6)],  subject  to  the  additional  constraints  expressed  in  Eqs. 
(7)  and  (8),  yields  the  following  expression  for  the  space-charge  field: 


mGf,EDGsmKcX  +  m|ffEDSsinKsx 


Ejjfx.t)  = 


x,t)dt  +  G(t)  ; 


_eff  = 
m£  — 


■f- 


1  +  mg^cosKcx  +  m|ffcosKsx 

«  1 

[1  -<m'fW 

^  j  1  +  cosK0x  +  m|ffcoslCs 

mG 

°s*s 

's 

1  + - 

°c*c 

—  exptfoc  -  os)d] 

*G 

mS 

°s^s 

>  +  — _  _  exptloc  -  a$)d] 
“0*0  *c 


Charge  conservation  equation  (integral  form): 


Assuming  further  that  the  effective  fringe  modulation  ratios  (mg' 
and  m|ff)are  small  and  that  EDS<<EDO<<E0.  the  space-charge 
field  amplitudes  at  each  harmonic  component  of  interest  are  given  by 


EjJx.tldx  =  0 


in  which  g(x)  is  the  generation  rate,  nd  is  the  free-carrier  concentra¬ 
tion  in  the  dark,  Eq  is  the  applied  transverse  field,  and  Oft)  is  a 
boundary-condition-dependent  constant  of  integration.  If  one 
assumes  that  the  quantum  efficiency  f,  which  is  the  probability  of 
creating  a  free  electron  per  unit  absorbed  photon  of  energy  h<u,  is  not 
wavelength-dependent  in  the  range  of  interest,  the  intensity  distribu¬ 
tion  Iffx)  gives  rise  to  the  free-carrier  generation  rate: 


Ek(Kg)  —  mg^  Eq  , 

Esc<kg  +  Ks>  =  mGf  msf,Eo  • 
E^Kc-Ks)  =  mG f  m|ff  Eq 


The  refractive  index  modulation  induced  along  a  principal  axis  by 
the  electrooptic  effect  is  then  given  by 
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I  . 

An(x)  =  -  ngr4,Esc(x) 

=  -J  n^r4|n^ff  E„  {cosKcx 

—  mfffcos[(KG  +  Ks)x]  —  m|ffcos[(Kc  —  Ks)x]},(l5) 


or,  by  combining  terms, 

An(x)  =  —  -  n^r4l  m^ff  ^(1  —  2m§ffcosK.sx)cosKGx  .  (16) 

For  small  diffraction  efficiencies  and  low  spatial  frequencies  Ks,  the 
diffracted  intensity  pattern  in  the  first  order  of  the  carrier  grating  can 
be  expressed  by  the  relation 

_____  /lrnor4i  mGf  E„  \2  ,  \ 


/7rngr4,mg‘  Eq  V  /  „  \ 

<(X)  =  ('  X^osfl  j  ('  -4<cosKsx] 


in  the  Kogelnik  formulation.16  in  which  the  angle  6  is  defined  as 
shown  in  Fig.  2.  This  expression  demonstrates  that  the  information 
contained  in  the  incoherent  incident  intensity  distribution  ls(x)[see 
Eq.  (I)]  is  transferred  onto  the  diffracted  beam,  performing  an 
incoherent-to-coherent  conversion  in  which  the  original  contrast  is 
reversed. 

For  the  case  of  uniform  erasure  (Ks  =  0),  the  diffracted  beams 
1,  |  and  ll0  are  degenerate  (see  Fig.  3).  For  the  case  of  modulated 
erasure  (Ks  0),  this  degeneracy  is  broken  and  separate  beams  are 
observed.  The  diffraction  efficiencies  in  these  two  cases  are  given  by 

p<ll0)°c[m£f<R)]2  E2  ,  (18) 

>7(I|,)<x[<ff(R)m|ff(R)]2  .  (19) 

in  which  R  is  the  ratio  of  the  incoherent  to  the  coherent  beam 
intensities  (R  =  ls;  IG).  Figures  1 1  and  12  illustrate  the  normalized 
diffraction  efficiency  of  the  1|0  beam  for  three  typical  erasure  wave¬ 
lengths  (Xj).  The  parameter  A5  is  the  ratio  of  the  erasure  beam  to  the 
writing  beam  intensity  absorption  coefficients  (A^  =  as/ <xq).  It  is 
interesting  to  note  that  the  maximum  energy  sensitivity  does  not 
generally  occur  for  wavelength  matching  (Xq  =  Xj).  In  fact,  two 
limiting  situationscan  be  recognized.  Fora  thin  crystal  ( Fig.  1 1 ),  the 
optimum  sensitivity  is  obtained  with  a  strongly  absorbed  erasure 
beam  because  the  generation  rate  increases  with  the  ratio  As,  while 
the  attenuation  factor  {exp[(«G  as)d]|  has  almost  noeffecl  on  the 
effective  modulation  m^"  Conversely,  for  a  thick  crystal  (Fig  12), 
the  exponential  term  dominates  and  the  optimum  sensitivity  is 
achieved  when  the  incoherent. source  has  the  same  wavelength  as  the 
laser  with  which  the  carrier  grating  is  recorded.  This  is  intuitively 
appealing  since  the  phase  grating  is  most  effectively  erased  through¬ 
out  the  volume  of  the  crystal  for  the  case  of  wavelength  matching. 

The  normalized  diffraction  efficiency  for  the  beam  1 , ,  in  the  case 
of  modulated  erasure  is  shown  in  Fig.  1 3.  As  predicted  by  Eq .  ( 19),  a 
maximum  exists  for  Reff  =  1: 
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Fig.  1 1 .  Normalized  diffraction  efficiency  of  the  l10  beam  (uniform  era- 
aurel  aa  a  function  of  the  intensity  ratio  (R)  for  a  0.13  cm  thick  crystal. 
Three  signal  beam  (S)  wavelengths  (X*)  with  corresponding  normelized 
absorption  coefficients  (Ag)  are  used  to  erase  the  coherent  grating  written 
at  wavelength  Xq  . 
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Fig.  12.  Normalized  diffraction  efficiency  of  the  l10  beam  (uniform  era¬ 
sure)  as  a  function  of  the  intensity  ratio  (R)  for  a  1 .0  cm  thick  crystal. 
Three  signal  beam  (S)  wavelengths  (Xg)with  corresponding  normalized 
absorption  coefficients  (Ag)  are  used  to  erase  the  coherent  grating  written 
at  wavelength  Xg . 
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The  existence  of  such  a  maximum  is  explained  as  follows.  It  is  clear 
that  when  Reff  =  0,  there  is  no  diffraction  in  the  in  direction.  In 
addition,  when  Reff  is  large,  the  uniform  component  of  the  incoher¬ 
ent  exposure  almost  completely  erases  the  carrier  grating  and  the 
diffracted  intensity  vanishes.  Therefore,  the  diffracted  component  in 
the  ( 1 1 )  direction  exhibits  a  maximum  for  some  intermediate  value  of 
R.rr 


It  should  be  noted  that  a  relatively  small  intensity  ratio  ( Reff  ~  I ) 
generates  the  maximum  signal  (IM),  but  the  uniform  background 
(1,0)  erasure  is  weak,  resulting  in  low  overall  contrast.  Conversely,  a 
large  ratio  (Reff>>l)  decreases  the  modulation  mf*f.  but  at  the 
same  time  diffraction  in  the  beam  l10  is  minimized  so  that  the  overall 
contrast  is  enhanced  at  the  expense  of  sensitivity.  In  Figs.  4  and  5,  R 
was  set  equal  to  10  in  order  to  maximize  the  contrast  in  the  negative 
imaging  mode  However,  a  number  of  specialized  readout  techniques 
(e.g.,  Schlieren  and  phase  contrast)  could  be  employed  to  simultane¬ 
ously  optimize  the  signal  intensity  and  the  contrast  ratio. 
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Fig.  13.  Normalized  diffraction  efficiency  of  the  lit  beam  (modulated 
erasure)  as  a  function  of  the  intensity  ratio  (R)  for  aO.1 3  cm  thick  crystal . 
Three  signal  beam  (SI  wavelengths  (A«)  with  corresponding  normalized 
absorption  coefficientslAd  are  used  to  erase  the  coherent  grating  written 
at  wavelength  ig. 
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2.4.  Experimental  results 

To  verify  the  essential  predictions  of  the  model  described  above,  the 
experimental  arrangement  shown  in  Fig.  14  was  utilized.  The  carrier 
grating  is  recorded  in  the  BSO  crystal  at  Kq  —  5 14  nm  and  read  out 
witha  Hc-Nelaserat  A„  =  633  nm  incident  at  the  Bragg  angle  .  The 
incoherent  grating  is  formed  with  a  Michelson  interferometer 
(M4,Ms)  using  the  blue  line  of  the  argon  laser  ( Aj  =  488  nm).  The 
far-field  diffraction  pattern  is  located  in  the  Fourier  plane  of  the  lens 
L.  The  results  of  theoretical  calculations  and  experimental  mea¬ 
surements  of  the  normalized  diffraction  efficiency  as  a  function  of 
the  intensity  ratio  R  are  presented  in  Fig.  15  for  the  case  of  uniform 
erasure  (Il0)  and  in  Fig.  16  for  the  case  of  modulated  erasure  (In). 
The  general  behavior  of  these  curves  is  in  agreement  with  the  model. 
The  discrepancy  in  the  amplitude  between  the  theoretical  prediction 
and  the  experimental  measurement  likely  derives  in  part  from  a  large 
difference  in  grating  modulation  ratio  between  the  two  treatments. 
Experimentally,  a  large  modulation  ratio  (mG  ~  I)  was  employed  in 
order  to  increase  the  diffracted  intensity  for  the  purpose  of  signal-to- 
noise  ratio  enhancement.  In  the  theoretical  development,  however, 
the  assumption  of  small  modulation  ratios  (mG<<  I )  was  necessary 
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Fig.  16.  Normalized  experimental  diffraction  efficiency  of  the  l^o  beam 
(uniform  eraaurel  as  a  function  of  the  intensity  ratio  (R).  The  correspond¬ 
ing  theoretics)  prediction  is  also  shown  for  comparison. 


sponding  theoretical  prediction  is  also  shown  for  comparison. 


to  achieve  analytic  solution  of  the  nonlinear  coupled  equations.  An 
increase  in  the  modulation  ratio  results  in  increased  space-charge- 
field  gradients  that  in  turn  enhance  erasure  sensitivity,  as  indicated 
by  the  experimental  results  shown  in  Fig.  15.  This  heightened  sensi¬ 
tivity  is  strongly  diminished  at  larger  intensity  ratios  due  to  the 
reduced  effective  modulation  ratio  that  results  from  uniform  grating 
erasure.  This  explanation  of  the  uniform  erasure  case  also  aids  in 
understanding  the  behavior  shown  in  Fig.  16  for  the  modulated  case 
(!,,'•  At  the  larger  (experimental)  modulation  ratio,  the  uniform 
component  of  the  incoherent  erasure  beam  is  more  effective  in  dimin¬ 
ishing  the  carrier  grating  (represented  by  l,0— see  Fig.  15)  than  the 
(low  modulation  ratio)  theory  predicts,  resulting  in  a  decrease  in 
sensitivity  of  I, !  at  low  values  of  R.  Onthe  other  hand,  for  values  of  R 
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much  greater  than  I ,  the  carrier  grating  is  erased  more  slowly  than  in 
the  theoretical  prediction.  This  results  in  a  more  gradual  decline  in 
the  I ,  t  diffraction  efficiency  with  increasing  R  than  would  occur  at 
lower  modulation  ratios  (see  Fig.  16). 


The  general  temporal  response  behavior  of  the  I),  (information¬ 
bearing)  diffracted  beam  is  shown  in  Fig.  17  for  the  two  cases 
R  as  1.5  and  R  =  S.O.  In  this  experiment,  the  coherent  grating  is 
established  in  the  saturation  regime  at  time  t  =  0,  at  which  point  the 
incoherent  erasure  beam  is  allowed  to  expose  the  crystal.  For  a  small 
ratio  R  (Is  =  0.6  mW/cm2  in  Fig.  17),  the  diffraction  efficiency 
increases  steadily  with  time  until  it  reaches  a  maximum.  However, 
for  a  strong  incoherent  beam  (ls  =  2  mW/cm2  in  Fig.  17),  a  tran¬ 
sient  effect  appears.  Initially,  the  beam  Il0  is  quite  intense  and 
diffracts  from  the  composite  grating  at  wave  vector  KG  +  Ks  to 
generate  a  rapid  rise  in  the  amplitude  of  In ,  but  the  uniform  part  of 
the  incoherent  illumination  simultaneously  erases  the  coherent  car¬ 
rier  grating  and  hence  the  diffraction  efficiency  decreases  to  a  small 
steady-state  value.  The  time  constant  for  this  particular  set  of  exper¬ 
imental  parameters  is  in  the  range  0.5  to  1 .5  s,  although  the  device 
response  time  can  be  decreased  by  increasing  the  intensity  of  the 
carrier  grating  writing  beams.  In  addition,  the  response  time  is 
strongly  dependent  on  a  number  of  intrinsic  and  extrinsic  material 
parameters.  The  full  range  of  variation  possible  for  the  temporal 
behavior  characteristic  is  not  firmly  established  at  this  point. 

3.  CONCLUSION 

We  have  demonstrated  the  feasibility  of  real-time  incoherent-to- 
coherent  conversion  utilizing  phase  conjugation  in  photorefractive 
BSO  crystals.  The  physical  basis  of  this  effect  is  explained  with  a 
simple  model  that  takes  into  account  the  influence  of  the  effective 
modulation  ratio  on  the  diffraction  efficiency  of  the  different  dif¬ 
fracted  beams.  Although  the  results  are  preliminary,  the  device  pro¬ 
posed  in  this  paper  has  potential  for  incoherent-to-coherent 
conversion  with  high  resolution,  which  can  be  realized  by  optimizing 
the  wave  vector  matching  condition  and  the  relative  intensities  and 
wavelengths  of  various  beams.  In  addition,  the  P1COC  device  is 
quite  attractive  from  considerations  of  low  cost,  ease  of  fabrication, 
and  broad  availability.  With  such  a  device,  numerous  optical  pro¬ 
cessing  functions  can  be  directly  implemented  that  utilize  the  flexibil¬ 
ity  afforded  by  the  simultaneous  availability  of  incoherenl-to- 
cohercnt  conversion  and  volume  holographic  storage. 
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ABSTRACT 

A  method  for  performing  incoherent-to-coherent  conversion  in  photoref ractive  crystals 
is  presented.  The  technique  is  experimentally  demonstrated  in  Bi12SiO20  and  a  theoretical 
framework  is  established  to  analyze  the  performance  of  the  device. 


INTRODUCTION 

Two  dimensional  optical  transparencies  are  used  in  the  implementation  of  optical  image 
processing  systems  as  input  incoherent-to-coherent  transducers,  and  are  also  used  for  the 
recording  of  Fourier  transform  holograms.  Most  of  the  early  optical  image  processors  were 
implemented  using  photographic  film  for  both  purposes.  The  need  for  real  time  operation  has 
prompted  the  development  of  devices  with  which  it  is  possible  to  form  reusable  optical 
transparencies  at  high  speed  (1,  2].  In  general,  however,  real  time  devices  that  are 
intended  for  use  as  input  spatial  light  modulators  (SLMs)  are  not  suitable  for  holographic 
recording  and  vice-versa.  This  distinction  exists  partially  due  to  the  fact  that  a  much 
higher  spatial  bandwidth  is  necessary  for  holographic  recording,  while  at  the  same  time  the 
properties  of  high  resolution  holographic  recording  media  (low  sensitivity,  response  at  low 
spatial  frequencies)  are  not  always  compatible  with  the  requirements  of  an  efficient 
incoherent-to-coherent  conversion  process.  Such  a  resolution-sensitivity  tradeoff  is 
familiar  from  the  example  of  photographic  (silver  halide)  films,  for  which  high  spatial 
bandwidth  is  in  general  accomplished  at  the  expense  of  lower  sensitivity. 

The  dichotomy  between  input  SLMs  and  holographic  elements  is  particularly  evident  in 
devices  that  are  fabricated  with  photoref ractive  (PR)  crystals.  Photoref ractive  crystals 
are  photosensitive  as  well  as  electrooptic.  This  feature  makes  it  possible  to  record  an 
optical  image  in  such  crystals,  and  subsequently  modulate  a  separate  optical  beam  with  the 
recorded  image.  Real  time  SLMs,  such  as  the  PROM  [3],  have  been  fabricated  with  the 
photorefractive  material  Bi12SiO20,  and  this  same  crystal  has  also  been  used  extensively  in 
real-time  holographic  experiments  [4].  The  configuration  and  the  properties  of  the 
holographic  devices,  however,  are  quite  different  from  the  PROM  and  other  similar  SLMs  that 


are  fabricated  with  Bi12SiO 
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In  this  paper  we  examine  a  method  for  performing  incoherent-to-coherent  conversion  with 
a  photorefractive  device  in  the  holographic  configuration.  There  are  two  primary  reasons 
that  have  motivated  us  to  investigate  this  possibility!  first,  the  construction  of  the 
holographic  device  is  inexpensive  and  simple,  and  second,  it  is  possible  to  record  very  high 
spatial  frequencies  in  photorefractive  crystals  in  the  holographic  configuration.  This 
technique  has  been  recently  demonstrated  experimentally  by  Kamshilin  and  Petrov  [5]  and 
independently  by  the  authors  [6].  In  this  paper  the  method  is  described,  experimental 
results  are  presented,  and  an  analytical  model  is  employed  to  determine  the  electric  fields 
induced  in  the  photorefractive  crystal  by  this  recording  mechanism. 
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INCOHERENT- TO- COHERENT  CONVERSION 


The  photorefractive  incoherent-to-coherent  optical  converter  is  shown  in  Fig.  1.  The 
photoref ractive  crystal  is  exposed  to  the  interference  pattern  of  two  coherent  plane  waves, 
which  induces  the  formation  of  a  phase  grating  in  the  crystal.  An  electric  field  is 
externally  applied  in  a  direction  parallel  to  the  grating  wavevector.  The  grating  formation 
is  attributed  to  photo-induced  generation  and  subsequent  retrapping  of  free  carriers, 
resulting  in  a  stored  periodic  space-charge  field.  The  space-charge  field  introduces  a 
proportional  modulation  of  the  index  of  refraction  in  the  crystal  through  the  electrooptic 
effect.  In  the  configuration  of  Fig.  1,  the  crystal  is  also  exposed  to  the  incoherent  image 
of  an  input  object.  The  exposure  to  the  incoherent  intensity  can  take  place  during,  after, 
or  before  the  formation  of  the  holographic  grating.  It  is  assumed  that  the  depth  of  focus 
of  the  imaging  system  is  sufficiently  long  so  that  the  incoherent  image  is  focused 
throughout  the  volume  of  the  photorefractive  crystal. 

The  incoherent  illumination  induces  photogenerated  carriers  in  the  conduction  band.  As 
these  carriers  diffuse  or  drift  and  are  retrapped,  they  partially  cancel  the  holographically 
induced  space-charge  distribution,  resulting  in  local  erasure  of  the  holographic  grating  in 
proportion  to  the  incoherent  intensity.  The  space-charge  field  that  results  from  the 
combined  exposure  to  the  coherent  and  incoherent  beams  is  a  periodic  grating  whose  amplitude 
is  modulated  approximately  proportional  to  the  negative  of  the  incoherent  image.  A  coherent 
reproduction  of  the  incoherent  image  can  be  obtained  by  illuminating  the  crystal  with  an 
auxiliary  laser  beam  at  the  appropriate  Bragg  angle  and  subsequently  forming  an  image  of  the 
diffracted  light. 
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Fig.  1.  Optical  system  for  the  implementation  of  incoherent-to-coherent  conversion 
with  a  photorefractive  crystal. 
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The  system  of  Pig.  1  was  assembled  in  the  laboratory  to  demonstrate  experimentally  the 
feasibility  of  this  technique.  A  (110)  plate  of  single  crystal  Bi,2SiO20  (BSO)  with 
dimensions  10mm  x  10 mm  x  2mm  was  used  and  an  electric  field  equal  to  6fcV/cm  was  applied  in 
the  <001>  direction.  The  holographic  grating  waa  formed  with  green  light  (X  »  514  nm) 
derived  from  an  Argon  ion  laser  at  a  spatial  frequency  equal  to  10  line  pairs/mm.  The 
average  intensity  of  the  coherent  beam  was  33  mW/cm2 .  The  Bii2SiO20  crystal  was  exposed 
simultaneously  to  an  incoherent  image  with  average  intensity  1.7  mW/cm2.  The  recorded  image 
was  read  out  with  an  expanded  beam  from  a  HeNe  laser  as  shown  in  Pig.  4,  and  the  coherent 
replica  was  obtained  by  imaging  the  plane  of  the  Bii2SiO20  plate  onto  the  output  plane. 
Examples  of  images  that  were  recorded  after  incoherent-to-coherent  conversion  are  shown  in 
Pig.  2. 

A  complete  description  of  the  performance  that  wbb  observed  in  these  initial 
experiments  is  presented  in  a  separate  paper  in  this  volume  [7].  We  will  briefly  summarize 
some  of  the  results  here.  Spatial  frequencies  in  excess  of  10  line  pairs/mm  were  recorded 
and  reconstructed,  resulting  in  converted  images  with  over  10  resolvable  pixels  with  the  1 
cm  crystal  used  in  the  experiments.  There  is  a  direct  trade-off  between  sensitivity  and 
speed.  Response  times  approximately  equal  to  30  msec  were  observed  with  relatively  high 
incoherent  intensity;  at  lower  intensities  (i  1  mW/cm2 )  the  response  time  was  approximately 
equal  to  500  msec.  It  should  be  emphasized  that  these  characteristics  are  simply 
preliminary  observations  at  this  stage.  All  of  the  performance  characteristics  depend 
strongly  on  materials  and  configuration  parameters,  and  numerous  tradeoffs  exist.  The 
physical  mechanisms  that  impose  the  fundamental  limitations  must  be  identified  before  the 
parameters  can  be  chosen  to  yield  optimum  overall  performance.  To  this  end,  a  mathematical 
model  is  employed  to  analyze  incoherent-to-coherent  conversion  in  photoref ractive  crystals, 
as  described  in  the  following  section. 


MATHEMATICAL  MODEL 


Holographic  grating  formation  in  photoref ractive  crystals  has  been  extensively  modeled  '-V\ 

[8].  The  same  basic  formalism  can  also  be  used  to  analyze  incoherent  image  recording  in  ‘‘  - 

photorefractive  crystals  through  erasure  of  a  holographic  grating.  The  analytical  framework  M#* 

that  has  been  proposed  by  Kukhtarev  18]  is  based  on  the  following  set  of  equations:  .*■  V 
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is  the  density  of  electrons  in  the  conduction  bend 


is  the  density  of  vacant  donor  sites 


is  the  electron  charge 


is  the  current  density 


is  the  coordinate  along  which  the  external  voltage  is  applied 


is  the  absorption  cross  section 


is  the  intensity  of  the  incident  optical  wave 


is  the  total  density  of  donor  sites 


is  the  recombination  coefficient 


is  the  electric  field  in  the  crystal 


is  the  dielectric  constant 


is  the  density  of  vacant  acceptor  sites  in  the  dark 


is  the  mobility 


is  Boltzmann's  constant 


is  the  temperature 


is  the  amplitude  of  the  electric  field  of  the  read-out  light 


is  the  optical  frequency 


is  the  electrooptic  coefficient 


is  the  index  of  refraction 


Equations  (l)-(4)  can  be  solved  to  determine  the  electric  field  E  that  is  induced  in 
the  crystal  by  exposure  to  the  input  optical  intensity  I.  Equation  (5)  is  'the  wave 
equation,  including  the  polarization  field  that  is  induced  by  the  electric  field  in  the 
crystal  through  the  electrooptic  effect.  Once  the  electric  field  E  is  determined  from  Eqs. 
(1) - (4) ,  Eq.  (5)  can  be  solved  using  coupled  mode  analysis  [10]  to  determine  the  optical 
field  diffracted  by  the  photoref ractive  crystal.  In  this  paper  we  concentrate  on 
determining  only  the  induced  field  E.  We  consider  the  simultaneous  exposure  of  the  crystal 
to  the  coherent  grating  and  an  incoherent  image.  The  total  light  intensity  incident  on  the 
crystal  is  the  sum  of  the  coherent  and  incoherent  intensities i 
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I(x,t)  -  Ic  [1  +  mc  cos(X0x)]4  I^x.t) 


(6) 


where  lc  is  the  average  intensity  of  the  coherent  light,  bc  is  the  modulation  depth  and 
K  /2k  is  the  spatial  frequency  of  the  coherent  grating.  The  intensity  of  -the  incoherent 
image  is  given  by  I^fx,  t) . 

The  set  of  Eqs.  ( 1) — ( 4)  describe  a^aystem  with  input  intensity  I(x,  t) ,  the  state  of 
which  is  described  by  the  four  variables  Nq,  n,  J  and  E.  The  solution  of  the  four  equations 
yields  the  electric  field  E.  The  fidelity  with  which  the  incoherent  image  I <  is  recorded 

can  be  investigated  by  studying  the  relationship  between  E  and  1^.  The  solution  of  Eqs. 
(l)-(4)  is  in  general  difficult  because  they  are  nonlinear.  Often  these  equations  are 
solved  by  making  simplifying  assumptions  that  lead  to  full  or  partial  linearization.  The 
effect  that  we  are  investigating,  however,  is  based  on  the  nonlinearities,  and  we  are 
therefore  primarily  interested  in  characterizing  the  nonlinear  part  of  the  response  of  the 
system.  For  this  reason,  we  have  included  in  the  analysis  all  of  the  nonlinear  terms.  The 
strongest  nonlinearity  typically  occurs  in  Eq.  (4)  where  the  current  density  J  is 
proportional  to  the  product  of  E  and  n,  the  number  density  of  electrons  in  the  conduction 
band.  The  product  nNg  that  appears  in  Eq.  (1)  can  also  be  a  significant  source  of 
nonlinearity. 

The  critical  role  that  the  nonlinearities  play  in  this  device  can  be  appreciated  by 
considering  the  electric  field  distributions  E  that  are  induced  by  exposure  to  the  coherent 
and  incoherent  beams  independently.  The  coherent  beams  alone  record  a  uniform  grating;  the 
incoherent  beam  alone  induces  a  field  distribution  that  is  not  an  accurate  reproduction  of 
the  incoherent  intensity  distribution  (more  on  this  later).  If  the  system  were  linear,  the 
combined  exposure  would  simply  induce  the  sum  of  these  two  field  distributions.  However, 
the  nonlinearities  give  rise  to  additional,  intermodulation  terms  in  E  and  these  are 
responsible  for  the  accurate  reproduction  of  the  incoherent  image  upon  reconstruction  of  the 
holographic  grating  that  is  observed  experimentally. 

The  steady  state  behavior  of  the  system  is  analyzed  by  setting  all  the  time  derivatives 
equal  to  zero  in  Eqs.  (l)-(4)  and  chooEing  an  incoherent  illumination  of  the  following  form: 


Ii(x,t)  -  Ii  [1  +  mi  cosd^x)]. 


in  which  m^  is  the  modulation  depth  and  Kx/2tt  the  spatial  frequency  of  the  incoherent 
grating.  In  this  case  the  solution  for  the  electric  field  E  is  in  the  form 

M  N 

E(X)  "  E  Z  Emn  exPf  j  <*nKc  4  nK.)x],  (8) 
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and  similarly  for  the  other  three  variables,  n,  ND,  and  J.  Equations  (l)-(4)  can  now  be 
solved  numerically,  using  the  method  of  successive  approximations,  to  obtain  the 
coefficients  of  the  expansion  in  Eq.  (8).  The  calculation  was  performed  for  m  -  mi  ■  1 , 
Kc/2n  ■  10  c/mm,  1^/217  *  10  c/mm,  and  material  parameters  that  were  given  by  Peltier  and 
Micheron  19]  for  Bi12SiO20. 

The  coefficients  E,,,  E0,  and  E^  are  plotted  in  Fig.  3  as  a  function  of  the  ratio 
R  "  Ii/Ic.  The  quantity  E11  is  the  coefficient  of  the  intermodulation  term  of 'interest, 
cos(K^x)  cos(Kcx).  It  i6  evident  in  Fig.  3  that  El:  attains  a  maximum  at  R  ■  1.  It  is 
interesting  to  note  that  in  the  experiments  reported  in  the  previous  section,  the  much 
higher  value  of  R  ^  52  was  used.  The  reason  for  this  choice  can  be  appreciated  by  observing 
the  behavior  of  EJ0.  The  quantity  E,0  is  the  coefficient  of  the  cos(Kj  *)  term,  and  upon 
reconstruction  it  results  in  a  uniform  plane  wave  diffracted  in  the  same  general  direction 
as  the  signal  beam  that  is  diffracted  due  to  the  En  grating.  As  a  result  it  acts  as  a 
constant  background  bias  that  reduces  the  contrast  of  the  coherent  image.  As  shown  in  Fig. 
3,  the  ratio  E;1/Ei0  increases  (and  hence  the  contrast  improves)  as  R  is  increased.  In  a 
coherent  optical  system,  a  constant  bias  can  be  easily  removed  by  spatial  filtering  and 
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incoherent  images  in  crystals  such  as  Bii2Si02o»  where  an  external  field  ia  required  for 
efficient  grating  recording.  A  simple  experiment  was  performed  to  demonatrate  this.  a 
tranaparency  of  a  neated-aquarea  pattern  waa  uaed  aa  the  incoherent  input  in  the 
experimental  aet-up  described  in  the  previous  section.  Coherent  reproductions  of  this 
object  were  obtained  from  the  Etl  and  E**  gratings  and  they  are  shown  in  Pigs.  4a  and  4b, 
respectively.  The  external  field  was  applied  in  the  horizontal  direction  of  Figs.  4.  It  is 
evident  that  information  is  recorded  only  in  the  direction  parallel  to  the  external  field 
with  direct  exposure,  whereas  two  dimensional  recording  is  possible  through  erasure  of  the 
holographic  grating. 


CONCLUSION 

A  novel  recording  method  in  photoref ractive  crystals  has  been  presented.  Our 
preliminary  experimental  and  theoretical  observations  indicate  that  incoherent-to-coherent 
conversion  can  be  implemented  with  this  mechanism.  Further  experimental  and  theoretical 
work  is  needed  to  assess  the  full  capabilities  of  this  device. 


ACKNOWLEDGMENTS 

The  research  reported  in  this  paper  is  supported  at  Caltech  by  the  Army  Research  Office 
and  the  Air  Force  Office  of  Scientific  Research;  at  USC  by  the  Air  Force  Systems  Command 
(RADC)  under  contract  F19628-83-C-0031 ,  the  Defense  Advanced  Research  Projects  Agency,  the 
Joint  Services  Electronics  Program,  and  the  Army  Research  Office. 

The  authors  would  like  to  thank  Y.  Shi  for  performing  some  of  the  experiments  described 
in  this  paper. 


REFERENCES 


A.  R.  Tanguay,  Jr.,  in  Proceedings  of  ARO  Workshop  on  Future  Directions  for 
Optical  Information  Processing,  Texax  Tech  University,  Lubbock,  Texas,  52-77, 
(1981) . 

D.  Casasent,  Proc.  IEEE.,  £2(5),  813  (1979). 

B.  A.  Horwitz  and  F.  J.  Corbett,  Opt.  Eng.,  12,  353,  (1978). 


R.  A.  Fisher,  ed.. 


I,  Academic  Press,  New  York,  (1983) . 


A.  A.  Kamshilin  and  M.  P.  Petrov,  Sov.  Tech.  Phys.  Lett.,  £(3) ,  144,  (1980). 

Y.  Shi,  D.  Psoitis,  a.  Narrakchi  and  A.  R.  Tanguay,  Jr.,  Appl.  Opt.,  22,  3665 
(1983). 

A.  Marrakchi,  A.  R.  Tanguay,  Jr.,  D.  Psaltis  and  J.  Yu,  this  volume. 

N.  V.  Kukhtarev,  et.  al.,  Ferroelec.,  22,  2414,  (1975). 

M.  Peltier  and  F.  Micheron,  J.  Appl.  Phys.,  ££,  3683,  (1977). 

H.  Kogelnik ,  Bell  Syst.  Tech.,  ££,  2909,  (1969). 


P BO TO RETRACTIVE  INCOHEREMT-TO-COHERDIT  OPTICAL  CONVERTERS 


4  '7 


PHYSICAL  AND  MATERIALS  CONSIDERATIONS 


A.  Marrakchi  and  A.  R.  Tanguay,  Jr. 

Optical  Materials  and  Devices  Laboratory 
Departments  of  Electrical  Engineering  and  Materials  Science 
University  of  Southern  California,  Los  Angeles,  California  90089-0483 

and 

J.  Yu  and  D.  Psaltis 
Department  of  Electrical  Engineering 
California  Institute  of  Technology,  Pasadena,  California  91125 


ABSTRACT 


Volume  holographic  storage  in  photoref ractive  Bi12SiO20  (BSO)  crystals  is  utilized  to 
perform  dynamic  incoherent-to-coherent  image  conversion  by  means  of  selective  spatial 
erasure  of  a  uniform  grating  with  white  (or  quasi-aonochromatic)  light.  Preliminary  results 
with  binary  and  grey  level  transparencies  are  presented,  and  the  conversion  process  is 
described  in  terms  of  a  simple  model  which  relates  the  diffracted  intensity  to  the 
space-variant  effective  modulation  ratio. 


INTRODUCTION 


Real-time  holography  in  photoref ractive  materials  has  been  utilized  for  many 
applications  in  the  areas  of  optical  processing  {1],  non-destructive  testing  of  vibrating 
structures  [2],  and  image  propagation  through  aberrating  media  [3],  In  addition,  the 
development  of  high  performance  spatial  light  modulators  has  received  much  recent  attention, 
primarily  for  incoherent-to-coherent  conversion  functions  in  optical  information  processing 
and  computing  applications  (4,  5].  We  have  reported  in  a  previous  paper  [6]  the  successful 
application  of  volume  phase  holography  to  the  real-time  conversion  of  an  incoherent  image 
(quasi-monochromatic  or  white  light  illumination)  into  a  coherent  replica.  Several  possible 
configurations  for  the  performance  of  this  image  transduction  in  photoref ractive  materials 
were  discussed  therein.  Such  a  conversion  process  has  been  investigated  independently,  as 
reported  in  reference  [7] . 

In  this  paper,  we  present  a  simple  model  that  describes  the  incoherent-to-coherent 
conversion  process  in  terms  of  the  space-var iant  effective  modulation  ratio.  The  model  is 
shown  to  satisfactorily  explain  the  principal  features  of  the  device  sensitometry  behavior. 
The  limiting  resolution  of  the  process  is  discussed,  and  geometric,  systemic,  and 
aiaterials-related  constraints  are  identified.  Experimental  measurements  of  the  device 
temporal  response  characteristics  are  presented. 

The  high  sensitivity  of  photoconductive  and  electrooptic  crystals  such  as  Bismuth 
Silicon  Oxide  (Bi.2SiO20  or  BSO)  in  the  visible  spectrum  has  allowed  the  simultaneous 
recording  and  reading  of  volume  holograms  to  be  achieved  with  time  constants  amenable  to 
real-time  operation.  The  holographic  recording  process  in  photoref ractive  materials 
involves  photoexcitation,  charge  transport,  and  trapping  mechanisms  [8,  9].  When  two 
coherent  writing  beams  are  allowed  to  interfere  within  the  volume  of  such  a  crystal,  free 
carriers  are  nonuniformly  generated  by  absorption,  and  are  redistributed  by  diffusion  and/or 
drift  under  the  influence  of  an  externally  applied  electric  field.  Subsequent  trapping  of 
these  charges  generates  a  stored  space-charge  field,  which  in  ‘urn  modulates  the  refractive 
index  through  the  linear  electrooptic  (Pockels)  effect  and  thus  records  a  volume  phase 
hologram.  If  both  coherent  writing  beams  are  plane  waves,  the  induced  hologram  will  consist 
of  a  uniform  grating. 
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In  the  Photoref ractive  Incoherent-to-Coherent  Optical  Conversion  (PICOC)  process,  in 
addition  to  the  holographically-induced  charge  distribution  stored  in  the  crystal,  an 
incoherent  image  is  focused  in  the  volume  of  the  photoref ractive  material,  and  creates  a 
spatial  modulation  that  can  be  transferred  onto  a  coherent  beam  by  reconstructing  the 
holographic  grating.  The  spatial  modulation  of  the  coherent  reconstructed  beam  will  then  be 
a  negative  replica  of  the  input  incoherent  image.  The  holographic  grating  can  be  recorded 
before,  during  or  after  the  crystal  is  exposed  to  the  incoherent  image.  Therefore,  a  number 
of  distinct  operating  modes  are  possible.  These  include  the  Grating  Erasure  Mode  (GEM) ,  the 
Grating  Inhibition  Mode  (GIM) ,  and  the  Simultaneous  Erasure/Writing  Node  (SEWM) ,  among 
others. 

In  the  Grating  Erasure  Mode,  a  uniform  grating  is  first  recorded  by  interfering  the  two 
coherent  writing  beams  in  the  photoref ractive  crystal.  This  grating  is  then  selectively 
erased  by  incoherent  illumination  of  the  crystal  with  an  image-bearing  beam.  The  incoherent 
image  may  be  incident  either  on  the  same  face  of  the  crystal  as  the  writing  beams,  or  on  the 
opposite  face.  When  the  absorption  coefficients  of  the  writing  and  image-bearing  beams  give 
rise  to  significant  depth  nonuniformity  within  the  crystal,  these  two  cases  will  have 
distinct  wavelength-matching  conditions  for  response  optimization. 
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In  the  Grating  Inhibition  Mode,  the  crystal  is  pre-illuminated  with  the  incoherent 
image-bearing  beam  prior  to  grating  formation.  This  serves  to  selectively  decay  (enhance) 
the  applied  transverse  electric  field  in  exposed  (unexposed)  regions  of  the  crystal.  After 
this  pre-exposure,  the  coherent  writing  beams  are  then  allowed  to  interfere  within  the 
crystal,  causing  grating  formation  with  spatially  varying  efficiency  due  to  significant 
differences  in  the  local  effective  applied  field. 


In  the  Simultaneous  Erasure/Writing  Mode,  the  incoherent  image  modulation,  the  coherent 
grating  formation  process,  and  the  readout  function  are  performed  simultaneously.  In  one 
possible  implementation  of  this  mode,  the  conventional  degenerate  four-wave  mixing  geometry 
can  be  modified  to  include  simultaneous  exposure  by  an  incoherent  image-bearing 
illumination,  as  shown  schematically  in  Fig.  1.  in  this  configuration,  the  coherent  replica 
of  the  incoherently-exposed  image  appears  in  the  conjugate  diffracted  beam. 

The  PICOC  process  can  thus  be  regarded  as  caused  by  selective  spatial  modulation  of 
a  grating  by  spatial  encoding  of  an  incoherent  erasure  beam.  It  should  be  noted  here  that  a 
related  image  encoding  process  could  be  implemented  in  a  non-holographic  manner  by 
pre-multiplication  of  the  image  with  a  grating  (105. 


PHOTOREFRACTIVE  INCOHERENT-TO-COHERENT  OPTICAL  CONVERSION 


In  the  remainder  of  this  paper,  we  examine  the  Simultaneous  Erasure/Writing  Mode  in 
more  detail.  As  a  specific  example,  we  will  discuss  the  configuration  in  which  the  coherent 
writing  beams  and  the  incoherent  image-bearing  beam  illuminate  the  same.face  of  a  BSO 
photoref ractive  crystal,  with  a  transverse  electric  field  applied  along  the  <110>  axis  as 
shown  in  Fig.  2.  Consider  an  incident  intensity  distribution  of  the  form 


with  I 
coheren 


IT(X)  -  IG<x)  +  Ig(x) 

«  I_(l  +  m_  cos  K_x)  +  I„(l  ♦  m.  cos  K_x) 


I-  ■  I,  +  I,  and  «G  •  2(1, 1,) *' Vlc,  in  which  Kc  and  K,  are  the  wavevectors  of  the 
nt  grating  (G)  and  a  particular  harmonic  component  of  the  incoherent  image  (S) ,  and 
d  ms  are  the  respective  modulation  ratios.  Due  to  the  nonlinear  dependence  of  the 


induced  space-charge  field  on  the  incident  intensity,  such  a  distribution  will  generate 
refractive  index  modulation  which  can  be  written  in  the  form 
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£n(x)  ■  C^  cos  KGx  +  C2  cos  Kgx 

♦  C3  cos  I (KG  -  Kg ) x] 

♦  C4  cos  [ (Kg  +  Kg) x] 

♦  Other  Terms. 
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Fig.  1  Experimental  configuration  for  photorefractive 
incoherent-to-coherent  optical  conversion  (PICOC)  in  the 
Simultaneous  Erasure/Writing  Mode  (SEWM) .  The  writing  beams  li 
and  Ij,  and  the  reading  beam  13,  are  generated  from  an  argon 
laser  (X  «  514  nm) .  The  phase  conjugate  beam  I4  is  diffracted 
at  the  same  wavelength.  The  transparency  T(x,  y)  is  illuminated 
with  a  xenon  arc  lamp  S  and  imaged  onto  the  Bii2Si02o  crystal 
with  the  optical  system  through  a  filter  FU  *  545  nm)  .  A 
coherent  replica  is  formed  in  the  output  plane  by  utilizing 
beamsplitter  BS  in  conjunction  with  lens  L2  to  image  the  surface 
of  the  crystal  onto  the  output  plane  through  polarizer  P. 


Bi<2Si02O 

CRYSTAL 


Fig.  2  PICOC  transverse  electrooptic  configuration  and  recording 
geometry.  The  volume  holographic  grating  with  wavevector  KG  is  formed 
by  the  coherent  writing  bejms  and  I2,  and  the  incoherent  information 
is  encoded  on  the  beam  1*. 


Note  in  particular  that  n(x)  contains  the  sun  and  difference  spatial  frequencies  as  well  as 
the  fundamental  harmonics.  The  constants  C^(i  «  1  to  4)  represent  the  amplitudes  of  each 
frequency  component.  Thus,  the  far-field  diffraction  pattern  shown  in  Pig.  3  will  comprise 
several  beams,  each  corresponding  to  a  specific  term  in  the  refractive  index  modulation. 


Fig.  3  Far-field  diffraction  pattern 
resulting  from  the  nonlinear  interaction  of 
two  gratings  in  a  photoief ractive  crystal. 


To  demonstrate  incoherent-to-coherent  conversion  in  the  four-wave  mixing  configuration, 
the  experimental  arrangement  of  Fig.  1  was  utilized  with  a  1.3  mm  thick  (llO)-cut  BSO 
crystal.  A  transverse  electric  field  (Eg  -  4  kv/cm)  was  applied  along  the  <110>  axis,  and 
the  carrier  frequency  of  the  holographic  grating  (f  -  300  line  pairs/mm)  was  chosen  to  lie 
within  the  optimum  range  for  drift-aided  charge  transport  in  BSO  [11]. 

In  this  implementation,  the  two  plane  wave  writing  beams  (labeled  Ij  and  l2)  are 
generated  from  an  argon  laser  (XG  ■  514  nm)  and  interfere  inside  the  (110) -cut  BSO  crystal  to 
create  a  volume  phase  hologram.  The  readout  beam  I3 ,  collinear  with  Ix  to  satisfy  the  Bragg 
condition,  is  diffracted  to  form  the  phase  conjugate  beam  l4  at  the  same  wavelength. 
Increased  diffraction  efficiency  results  when  a  transverse  electric  field  is  applied  to  the 
electrooptic  medium.  An  incoherently  illuminated  transparency  T(x,  y) ,  with  intensity 
I- (x,  y)  (either  quasi-monochromatic  or  white  light),  is  imaged  in  the  plane  of  the  crystal. 
The  beam-splitter  BS  separates  the  diffracted  signal  from  the  writing  beam,  and  the 
polarizing  filter  P  in  the  output  plane  eliminates  the  unwanted  scattered  light  to  enhance 
the  signal-to-noise  ratio  [12).  The  vertically  polarized  coherent  writing  beam  and  signal 
intensities  were  I1>2  -  0.4  mw/c *  and  I  -  6  mN/cnr ,  respectively.  The  incoherent 
illumination  was  provided  by  a  xenon  arc  lamp  through  a  broadband  filter  centered  at 
Xs  -  545  nm  (FWHM  -  100  nm) . 

The  converted  images  obtained  from  two  binary  transparencies  (a  spoke  target  and  a  USAF 
resolution  target) ,  and  from  a  black  and  white  slide  with  grey  levels  are  shown  in  Figs.  4 
and  5,  respectively.  The  original  transparency  and  itB  converted  image  have  reversed 
contrast.  An  approximate  resolution  of  15  line  pairs/mm  (as  derived  from  the  resolution 
target  image)  was  achieved  without  optimizing  factors  such  as  the  optical  properties  and 
quality  of  the  crystal,  the  depth  of  focus  in  the  bulk  of  the  medium,  the  carrier  frequency 
of  the  grating,  the  relative  intensities  and  wavelengths  of  the  various  beams,  or  the  Bragg 
diffraction  condition  (discussed  below).  This  spatial  bandwidth  is  comparable  to  that 
obtained  with  a  PROM  [13]  or  a  liquid  crystal  light  valve  [14]. 

A  number  of  distinct  factors  influence  the  ultimate  resolution  achievable  with  the 
PICOC  spatial  light  modulator.  These  factors  can  be  classified  as  geometric,  systemic,  and 
materials-related  in  nature.  Each  of  these  resolution  limitations  are  described  in  detail 
below. 


(b). 


Fig.  5  Photorefractive  incoherent-to- 
coherent  optical  conversion  of  a  grey-level 
transparency. 


Pig.  4  Photorefractive  incoherent-to- 
coherent  optical  conversion  of  two  binary 
transparencies:  (a)  spoke  target,  and  (b) 
USAF  resolution  target. 


Geometric  resolution  limitations  derive  principally  from  the  incorporation  of  an 
incoherent  imaging  system  in  the  four-wave  mixing  geometry,  and  from  the  finite  crystal 
thickness  required  to  create  a  volume  holographic  grating.  These  effects  are  illustrated  in 
Fig6.  6  and  7.  Pigure  6  describes  the  caBe  for  which  asd<l,  such  that  the  induced 
holographic  grating  has  finite  amplitude  throughout  the  volume  of  the  crystal.  As  can  be 
seen  from  the  Pigure,  the  optimum  focal  point  occurs  in  the  volume  of  the  crystal  (in  the 
center  whenasd<<l),  and  is  not  localized  on  the  front  surface  of  the  crystal.  The 
resolution  will  then  be  proportional  to  (W/2)~  ,  which  is  in  turn  equal  to  4n  Pt/d.  In  this 
expression,  n  is  the  refractive  index  of  the  electrooptic  crystal,  P#  is  the  P-number  of  the 
input  Incoherent  imaging  system  (assumed  1:1),  and  d  is  the  crystal  thickness.  For  example, 
for  n  •  2.5,  d  ■  1mm,  and  an  P-number  of  5,  the  resolution  limit  is  approximately  50  line 
pairs/mm.  Pigure  7  describes  the  case  for  which  a,d>>l,  such  that  the  Induced  holographic 
grating  has  significant  amplitude  only  within  a  thin  layer  of  thickness  dcff  ■  aj  .  In  this 
case,  the  resolution  will  be  given  by  4n  F#as.  For  n  •  2.5,  d  •  1mm,  as  ■  100cm"1,  and 
an  F-number  of  5,  the  resolution  limit  is  approximately  500  line  pairs/mm. 


Several  systemic  resolution  constraints  derive  from  the  utilization  of  a  volume 
hologram  in  the  image  conversion  process.  One  such  constraint  is  that  the  coherent  grating 
spatial  frequency  must  be  significantly  larger  than  the  signal  (Incoherent  image)  bandwidth 
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in  order  to  effect  separation  of  the  0th  and  1>C  order  diffracted  bean  components.  In 
addition,  the  range  of  spatial  frequencies  distributed  about  the  coherent  grating  spatial 
frequency  should  be  in  an  optimum  region  of  the  modulation  transfer  characteristic  of  the 
device. 
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AnF# 


(W/2)  d 
n  =  2.5,  d  =  imm,  F#  =  5, 
R  =  50  line  poirs/mm 


Fig.  6  Geometric  constraints  imposed  on 
PICOC  resolution  by  the  finite  F-number  of 
the  input  optics,  for  the  case  od  <  1. 


EXAMPLE:  FOR  n  =  2.5,  d=1mm,  F#*5,  a *  100  cm* 
R  1  500  line  poirs/mm 


Fig.  7  Geometric  constraints  imposed  on 
PICOC  resolution  by  the  finite  F-number  of 
the  input  optics,  for  the  case  ad  >>  1. 
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A  third  fundamental  systemic  constraint  on  the  PICOC  device  resolution  derives  from 
Bragg  detuning  effects  associated  directly  with  the  use  of  a  volume  hologram.  This  effect 
is  strikingly  illustrated  in  Figure  8,  which  is  comprised  of  converted  images  of  a  5  line 
pair/mm  Ronchi  ruling  and  their  related  coherent  Fourier  transforms,  for  two  orthogonal 
orientations  of  the  incoherent  grating  wavevector  relative  to  the  coherent  grating 
wavevector.  As  can  be  seen  from  the  Figure,  a  significant  difference  in  resolution  exists 
between  cases  in  which  the  wavevector  of  the  ruling  (incoherent  grating)  is  parallel  or 
perpendicular  to  the  coherently-written  (holographic)  grating.  This  difference  derives 
principally  from  a  wavevector  matching  condition,  as  shown  in  Figs. 9  and  10.  In  Fig.  9,  the 
incoherent  grating  wavevector  is  parallel  to  the  coherent  grating  wavevector,  a  condition 
achieved  by  symmetr ieally  disposing  the  incident  coherent  beams  about  the  normal  to  the 
crystal,  while  simultaneously  arranging  the  Incoherent  imaging  system  such  that  its  optical 
axis  is  parallel  to  the  crystal  normal.  In  this  case,  significant  Bragg  detuning  occurs  for 
even  small  incoherent  grating  wavevectors  (resulting  in  angular  deviations  of  the  diffracted 
beam).  In  Fig.  10,  the  incoherent  grating  wavevector  is  arranged  to  lie  tangent  to  the 
circle  defined  by  the  incident  coherent  grating  wavevectors,  such  that  a  significantly 
increased  angular  deviation  of  the  diffracted  beam  is  allowed  before  significant  Bragg 
detuning  effects  occur.  Such  a  wavevector  tangency  condition  is  automatically  satisfied 
when  the  incoherent  grating  wavevector  is  normal  to  the  coherent  grating  wavevector  (as  it 
is  in  the  orientation  normal  to  the  plane  of  incidence).  For  the  arrangement  described  in 
Fig.  10,  wavevector  tangency  is  assured  for  both  orientations,  so  that  the  horizontal  and 
vertical  resolutions  become  degenerate  for  this  case.  An  equivalent  condition  is  described 
in  Ref.  (7]  for  the  case  of  distinct  reading  and  writing  beam  wavelengths. 

A  fourth  related  systemic  constraint  involves  the  tradeoff  between  saturation 
diffraction  efficiency  and  achievable  resolution  due  to  grating  thickness.  Within  limits, 
increases  in  grating  thickness  increase  the  diffraction  efficiency,  but  at  the  seme  time 
increase  the  Bragg  detuning  per  unit  angle.  This  condition  creates  a  familiar 
resolution/sensitivity  tradeoff  situation  in  which  one  can  be  optimized  at  the  expense  of 
the  other. 
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Additional  resolution  limitations  derive  from  material  parameter  constraints  that 
influence  the  physics  of  grating  formation.  This  limitation  is  essentially  described  by  the 
behavior  of  the  diffraction  efficiency  as  a  function  of  the  spatial  frequency  with  the 
applied  transverse  electric  field  as  a  parameter  [11].  The  amplitude  modulation  transfer 
function  of  the  grating  itself  depends  on  the  spatial  frequency  dependence  of  the  maximum 
space-charge  field,  which  in  turn  depends  on  carrier  mobilities  and  lifetimes,  the  applied 
field,  the  nature  and  distribution  of  traps  in  the  crystal,  and  the  trap  occupancy  (Fermi) 
level. 


Optimization  of  the  PICOC  device  resolution  necessarily  involves  simultaneous 
satisfaction  of  all  three  types  of  constraints,  and  must  be  undertaken  also  in  compromise 
with  factors  that  directly  affect  the  device  sensitivity.  In  succeeding  paragraphs,  we 
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Fig.  8  Coherent  replica  linages  and 
'  corresponding  Fourier  transforms  of  a  5 
^  line  pair  per  mm  Ronchi  ruling  after 
■m  photoref  ractive  incoherent-to-coherent 
"  conversion. 
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present  a  model  that  allows  the  device  sensitivity  to  be  understood  and  optimized.  It 
should  be  noted  here  that  amplification  via  energy  transfer  has  been  observed  in  the 
four-wave  mixing  configuration  in  BaTi03  [15],  and  in  the  two-wave  mixing  configuration  in  a 
BSO  crystal  [16,  17].  By  utilizing  this  effect  in  the  PICOC  geometry  described  in  this 
paper,  incoherent-to-coherent  conversion  could  be  performed  with  improved  energy  sensitivity 
without  sacrifice  of  resolution. 

The  following  simple  model  describes  the  encoding  of  the  incoherent  information  onto 
the  coherent  diffracted  beam,  by  taking  into  account  only  the  effective  modulation  ratio  of 
the  exposure  in  the  bulk  of  the  photoref ractive  material.  The  different  intensities 
incident  on  the  crystal  are  as  shown  in  Fig.  2.  The  intensity  pattern  resulting  from 
simultaneous  illumination  with  the  coherent  writing  beams  and  the  incoherent  image-bearing 
beam  is  given  by  Eqn.  (1) ,  which  describes  the  case  of  a  one-dimensional  incoherent 
sinusoidal  grating  with  a  fundamental  component  at  wavevector  Rs.  The  space-charge  field 
E*c  is  related  to  the  current  density  J(x,  t)  and  the  free-carrier  concentration  n(x,  t) 
through  the  following  syBtem  of  equations  [18] i 
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Fig.  9  Wavevector  diagram  of  the  photorefractive  incoherent-to- 
coherent  conversion  process,  for  the  case  of  collinear  signal  (Ks) 
and  grating  (KG)  wavevectors .  Readout  with  a  beam  incident  at 
wavevector  kj  results  in  diffracted  beams  at  k4  +  and  k4_,  with 
corresponding  Bragg  mismatches  4K+  and  L K_. 


Current  density  equation 

J(x,t)  -  eD  3n-^‘- 1  +  eun(x.t)  [E,c(x,t)  ♦  EQ] 
Continuity  equation 

>n(x,t)  n(x,t)  “  0^  1  3J(x,t) 

— ^ - t -  4  T  ~ 37 - 


Maxwell's  equation  (integral  form) 

E>c(x,t)  ■  -  -i-  J  J(x,t)dt  ♦ 


/E.c(x'  t> 


dx  ■  0 


in  which  g(x)  is  the  generation  rate,  nd  is  the  free-carrier  concentration  in  the  dark, 
E0  is  the  applied  transverse  field,  and  G(t)  is  a  boundary  condition-dependent  constant  of 
integration.  If  one  assumes  that  the  quantum  efficiency  £,  which  is  the  probability  of 
creating  a  free  electron  by  an  absorbed  photon  of  energy  flu,  is  not  wavelength-dependent  in 
the  range  of  interest,  the  intensity  distribution  XT(x)  gives  rise  to  the  free-carrier 
generation  rate 

arS  o-t 

g(x)  *  —  IG ( 1  ♦  mG  cos  KqX)  exp(-aGd)  +  lg(l  *  mg  cos  Kgx)  exp(-ogd)  (7) 
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Fig.  10  Wavevector  diagram  of  the  photoref ractive  incoherent- to- 
coherent  optical  conversion  process,  for  the  case  wherein  the  signal 
wavevector  is  tangent  to  the  equiphase  circle.  Readout  with  a  beam 
incident  at  wavevector  k3  results  in  diffracted  beams  at  k4  +  and  k4., 
with  significantly  reduced  Bragg  mismatches  6K+  and  AX.. 


in  which  d  is  the  crystal  thickness,  and  the  intensity  absorption  coefficients  are  a-  at 
Xs  and  aG  at  Xc.  Since  f tee-carrier  redistribution  will  occur  both  by  drift  and  diffusion, 
the  resultant  space-charge  field  will  depend  on  both  the  carrier  concentration  n(x)  and  its 
spatial  gradient  3n/3x.  Solution  of  this  system  of  equations  i6  extremely  complicated  in 
general,  and  must  be  accomplished  in  the  context  of  boundary  conditions  applicable  to  a 
given  experimental  situation.  In  the  development  that  follows,  several  simplifying 
assumptions  are  made  that  are  appropriate  for  the  SEWM  configuration  in  the  steady  state, 
and  in  the  large  transverse  applied  field  limit  (to  enhance  the  saturation  diffraction 
efficiency) . 

In  the  saturation  regime  (steady  state),  the  current  density  is  constant  and  the 
carrier  concentration  is  given  by 

n(x)  -  nd  ♦  xg  (x)  (8) 


in  which  the  free-carrier  lifetime  t  is  assumed  to  be  the  same  for  the  writing  and  the 
erasure  beams,  and  unaffected  by  the  presence  or  absence  of  illumination.  In  the  strong 
drift  regime  for  which  the  applied  field  is  much  larger  than  the  diffusion  field 
(E0  >>  Edj  Ed  •  KkBT/e) ,  solution  of  the  system  of  Eqns.  (3-6)  subject  to  the  additional 
constraints  expressed  in  Eqns.  (7)  and  (8)  yields  the  following  expression  for  the 
space-charge  field 
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Assuming  further  that  the  effective  fringe  modulation  ratios  (m|ff,  a|ff)  are  small 
Eps  <<  EdG  <<  Eg,  the  space-charge  field  amplitudes  at  each  harmonic  component  of 
are  given  by: 


(11) 
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(14) 


The  refractive  index  modulation  induced  along  a  principal  axis  by  the  electrooptic  effect  is 
then  given  by 


An(x)  -  4-  nj  r41  £,c<x) 

-  -  T  n0  r41  mGff  E0  Icos  V  -  f  COs(KG  +  KS>*  -  Bfff  COs(KG  -  KS,x]  - 
or,  by  combining  terms. 


An(x)  -  -  r«l  “Gff  E0  li  *  608  KSx^cos  V- 


(15) 


(16) 


For  small  diffraction  efficiencies  and  low  spatial  frequencies  Ks,  the  diffracted  intensity 
pattern  in  the  first  order  of  the  carrier  grating  can  be  expressed  by  the  relation 


I4 (x)  ■  Ij 


c*  trs.f  *  E°y  (. 


4m|££  cos  Ksx) 


(17) 


in  the  Kogelnik  formulation  (19) .  This  expression  demonstrates  that  the  information 
contained  in  the  Incoherent  incident  intensity  distribution  Is(>)  (see  Eqn.  (1))  is 
transferred  onto  the  coherent  diffracted  beam,  performing  an  incoherent-to-coherent 
conversion  in  which  the  original  contrast  is  reversed. 
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For  the  case  of  uniform  erasure  (x5  •  0) ,  the  diffracted  beams  Iii  and  I10  are 
degenerate  (see  Fig.  3) .  For  the  case  of  modulated  erasure  (Ks  f  0) ,  this  degeneracy  is 
broken  and  separate  beams  are  observed.  The  diffraction  efficiencies  in  these  two  cases  are 
given  bys 

MX10>  «  lm*ff(R>]2  U8> 


n(Iu)  «  [m*ff  <R)m|ff  <R>  ]  2  E2  (19) 


where  R  is  the  ratio  of  the  incoherent  to  the  coherent  beam  intensities  (R  -  XS/IG). 
Figures  11  and  12  illustrate  the  normalized  diffraction  efficiency  of  the  Iiq  beam  for  three 
typical  erasure  wavelengths  (X.).  The  parameter  Ag  is  the  ratio  of  the  erasure  beam  to  the 
writing  beam  intensity  absorption  coefficients  (Ac  *  as/ac) .  it  is  interesting  to  note  that 
the  maximum  energy  sensitivity  does  not  generally  occur  for  wavelength-matching  (XG  ■  Xs) . 
In  fact,  two  limiting  situations  can  be  recognized.  For  a  thin  crystal  (Fig.  11),  the 
optimum  sensitivity  is  obtained  with  a  strongly  absorbed  erasure  beam  because  the  generation 
rate  increases  with  the  ratio  As,  while  the  attenuation  factor  (exp(aG  -  as)d]  has  almost  no 
effect  on  the  effective  modulation  m£ff.  Conversely,  for  a  thick  crystal  (Fig.  12),  the 
exponential  term  dominates  and  the  optimum  sensitivity  is  achieved  when  the  incoherent 
source  has  the  same  wavelength  as  the  laser  with  which  the  carrier  grating  is  recorded. 
This  i6  intuitively  appealing  since  the  phase  grating  is  most  effectively  erased  throughout 
the  volume  of  the  crystal  for  the  case  of  wavelength  matching. 


INTENSITY  RATIO  (R)  INTENSITY  RATIO  (R) 


Fig.  11  Normalized  diffraction  efficiency  Fig.  12  Normalized  diffraction  efficiency 

of  the  Ii  o  beam  (Uniform  Erasure)  as  a  of  the  Ii0  beam  (Uniform  Erasure)  as  a 

function  of  the  intensity  ratio  (R)  for  a  function  of  the  intensity  ratio  (R)  for  a 

0.13  cm  thick  crystal.  Three  signal  beam  1.0  cm  thick  crystal.  Three  signal  beam 

(S)  wavelengths  (Xs)  with  corresponding  (S)  wavelengths  (x$)  with  corresponding 

absorption  coefficients  (As)  are  used  to  absorption  coefficients  (As)  are  used  to 

erase  the  coherent  grating  written  at  erase  the  coherent  grating  written  at 

wavelength  XG.  wavelength  xG. 


The  normalized  diffraction  efficiency  for  the  beaa  In  in  the  caae  of  Modulated  erasure 
is  shown  in  Fig.  13.  As  predicted  by  Eqn.  (19),  a  maximum  exists  for  R,ff  »  1  where: 


Reff  "  R  A1  exP(aG  "  XS)d 
G  G 


(20) 


The  axistence  of  such  a  maximum  is  explained  by  the  following.  It  is  Clear  that  when 
Reff  •  0,  there  is  no  diffraction  in  the  Indirection.  In  addition,  when  R,f{  is  large,  the 
uniform  component  of  the  incoherent  exposure  almost  completely  erases  the  carrier  grating 
and  the  diffracted  intensity  vanishes.  Furthermore,  a  small  intensity  ratio  (Reff  ^  1) 
generates  the  maximum  signal  (In)'  but  the  uniform  erasure  (I10)  is  weak  and  as  a  result 
the  overall  contrast  is  low.  Conversely,  a  large  ratio  (RCff>>l),  decreases  the  modulation 
m|ff,  but  at  the  same  time  diffraction  in  the  beam  I10  is  minimized  so  that  the  overall 
contrast  is  enhanced  at  the  expense  of  sensitivity.  In  Figs.  4  and  5,  R  was  set  equal  to  10 


Fig.  13  Normalized  diffraction  efficiency 
of  the  Ii}  beam  (Nodulated  Erasure)  as  a 
function  or  the  Intensity  ratio  (R)  for  a 
0.13  cm- thick  crystal.  Three  signal  beam 
(S)  wavelengths  (Xs)  with  corresponding 
absorption  coefficients  (A5)  are  used  to 
erase  the  coherent  grating  written  at 
wavelength  Xc. 


in  order  to  maximize  the  contrast  in  the  negative  imaging  mode.  However,  a  number  of 
specialized  readout  techniques  (e.g.  Schlieren,  phase  contrast)  could  be  employed  to 
simultaneously  optimize  the  signal  intensity  and  the  contrast  ratio. 

To  verify  the  essential  predictions  of  this  simple  model  described  above,  the 
experimental  arrangement  shown  in  Fig.  14  has  been  utilized.  The  carrier  grating  is 
recorded  in  the  BSO  crystal  at  XG  ■  514  nm  and  read  out  with  a  He-Ne  laser  at  XB  *  633  nm 
incident  at  the  Bragg  angle.  The  incoherent  grating  is  formed  with  a  Michelson 
interferometer  (M4 ,  H5 )  using  the  blue  line  of  the  argon  laser  (X*  «  486  nm) .  The  far-field 
diffraction  pattern  is  located  in  the  Fourier  plane  of  the  lens  L.  The  results  of 
theoretical  calculations  and  experimental  measurements  of  the  normalized  diffraction 
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PICOC:  Experimenlol  Set-up  for  Sensitometrv  ond  Tronsfer 
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Fig.  14  Experimental  arrangement  for  sensitivity  and  transfer  function 
measurements,  as  described  in  detail  in  the  text. 


efficiency  as  a  function  of  the  intensity  ratio  R  are  presented  in  Fig.  15  for  the  case  of 
uniform  U1(,)  erasure,  and  in  Fig.  16  for  the  case  of  r  sdulated  ( I x  x )  erasure.  The  general 
behavior  of  these  curves  is  in  agreement  with  the  model.  The  discrepancy  in  the  amplitude 
between  the  theoretical  prediction  and  the  experisiental  measurement  likely  derives  from,  a 
large  difference  in  grating  modulation  ratio  between  the  two  treatments.  Experimentally,  a 
large  modulation  ratio  (mG  i  1)  was  employed  in  order  to  Increase  the  diffracted  intensity 
for  the  purpose  of  signal-to-noise  ratio  enhancement.  In  the  theoretical  development, 
however,  the  assumption  of  small  modulation  ratios  (*<;<<!)  was  necessary  to  achieve  analytic 
solution  of  the  nonlinear  coupled  equations.  An  increase  in  the  modulation  ratio  results  in 
increased  space  charge  field  gradients  that  in  turn  enhance  erasure  sensitivity,  as 
indicated  by  the  experimental  results  shown  in  Fig.  15.  This  heightened  sensitivity  is 
strongly  diminished  at  larger  intensity  ratios  due  to  the  reduced  effective  modulation  ratio 
that  results  from  uniform  grating  erasure.  This  explanation  of  the  uniform  erasure  case 
also  aids  in  understanding  the  behavior  shown  in  Fig.  16  for  the  modulated  case  (In).  At 
the  larger  (experimental)  modulation  ratio,  the  uniform  component  of  the  incoherent  erasure 
beam  is  more  effective  in  diminishing  the  carrier  grating  (represented  by  Iio  “  see  Fig.  15) 
than  the  (low  modulation  ratio)  theory  predicts,  resulting  in  a  decrease  in  sensitivity  of 
Ill  at  low  values  of  R.  On  the  other  hand,  for  values  of  R  much  greater  than  1,  the  carrier 
grating  is  erased  more  slowly  than  in  the  theoretical  prediction.  This  results  in  a  more 
gradual  decline  in  the  In  diffraction  efficiency  with  increasing  R  than  would  occur  at 
lower  modulation  ratios  (see  Fig.  16) . 

The  general  temporal  responae  behavior  of  the  In  (information-bearing)  diffracted  beam 
is  shown  in  Fig.  17  for  the  two  cases  R  «  1.5  and  R  ■  5.0.  In  this  experiment,  the  coherent 
grating  is  established  and  in  the  saturation  regime  at  time  t  ■  0,  at  which  point  the 
incoherent  erasure  beam  is  allowed  to  expose  the  crystal.  For  a  small  ratio 
R  (ls  "  0.6  mw/cm2  in  Fig.  17),  the  diffraction  efficiency  increases  steadily  with  time 
until  it  reaches  a  maximum.  However,  for  a  strong  incoherent  beam  (lc  -  2  mw/cm2  in  Fig. 
17) ,  a  transient  effect  appears.  Initially,  the  beam  Iio  1®  quite  Intense  and  diffracts 
from  the  composite  grating  at  KG  4  Ks  to  generate  a  rapid  rise  in  the  amplitude  of  In,  but 
the  uniform  part  of  the  incoherent  illumination  simultaneously  erases  the  coherent  carrier 
grating  and  hence  the  diffraction  efficiency  decreases  to  a  small  steady-state  value.  The 
time  constant  for  this  particular  set  of  experimental  parameters  is  in  the  range  0.5-1. 5 
sec.,  although  the  device  response  time  can  be  decreased  by  increasing  the  intensity  of  the 
carrier  grating  writing  beams.  In  addition,  the  response  time  is  strongly  dependent  on  a 
number  of  Intrinsic  and  extrinsic  materials  parameters.  The  full  range  of  variation 
possible  for  the  temporal  behavior  characteristic  is  not  firmly  established  at  this  point. 
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Fig.  15  Normalized  experimental 
diffraction  efficiency  of  the  l10  beam 
(Uniform  Erasure)  as  a  function  of  the 
intensity  ratio  (R) .  The  corresponding 
theoretical  prediction  is  also  shown  for 
comparison. 


Fig.  16  Normalized  experimental 
diffraction  efficiency  of  the  111  beam 
(Modulated  Erasure)  as  a  function  of  the 
intensity  ratio  (R) .  The  corresponding 
theoretical  prediction  is  also  shown  for 
comparison. 
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Fig.  17  Measured  diffraction  efficiency  of 
the  In  beam  (Modulated  Erasure)  as  a 
function  of  response  time  for  two  values  of 
the  signal  Intensity. 
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In  conclusion,  we  have  demonstrated  the  feasibility  of  real-time  incoherent-to-coherent 
conversion  utilising  phase  conjugation  in  photorefractive  BSO  crystals.  The  physical  basis 
of  this  effect  is  explained  with  a  simple  model  which  takes  into  account  the  influence  of 
the  effective  modulation  ratio  on  the  diffraction  efficiency  of  the  different  diffracted 
beams.  Although  the  results  are  preliminary,  the  device  which  is  proposed  in  this  paper  has 
potential  for  incoherent-to-coherent  conversion  with  high  resolution,  which  can  be  realized 
by  optimising  the  wavevector  matching  condition  and  the  relative  intensities  and  wavelengths 
of  the  various  beams.  In  addition,  the  PICOC  device  is  quite  attractive  from  considerations 
of  low  cost,  ease  of  fabrication,  and  broad  availability.  Kith  such  a  device,  numerous 
optical  processing  functions  can  be  directly  implemented  that  utilise  the  flexibility 
afforded  by  the  simultaneous  availability  of  incoherent-to-coherent  conversion  and  volume 
holographic  storage. 
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Bias-free  time-integrating  optical  correlator  using  a 
photorefractive  crystal 


Demetri  Psaltis,  Jeffrey  Yu,  and  John  Hong 


An  acoustooptic  time-integrating  correlator  is  demonstrated  using  a  photorefractive  crystal  as  the  time- 
integrating  detector. 


I.  Introduction 

Time  integration1  has  proved  to  be  a  powerful  tech¬ 
nique  in  optical  signal  processing  and  has  been  used  in 
a  wide  variety  of  architectures.  A  major  drawback  of 
time-integrating  processors  is  the  buildup  of  bias  in 
addition  to  the  signal.  This  occurs  because  the  photo¬ 
generated  charge  that  is  integrated  on  the  detector  is 
proportional  to  the  intensity  of  the  optical  signal  which 
makes  it  necessary  to  represent  bipolar  signals  on  a 
bias.  The  effective  system  dynamic  range  at  the  out¬ 
put  is  given  by  DR'  *  DR  [SBR/(1  +  SBR)]  where  DR 
is  the  dynamic  range  of  the  output  detector  and  SBR  is 
the  signal-to-bias  ratio  on  the  detector.2  In  most  cases 
of  interest,  the  SBR  is  much  smaller  than  unity  and 
thus  the  added  bias  significantly  reduces  the  usable 
dynamic  range  of  the  system. 

The  most  frequently  used  method  for  separating  the 
signal  from  the  bias  involves  placing  the  signal  on  a 
spatial  carrier  and  then  electronically  filtering  the  out¬ 
put  of  the  integrator.  This  method  of  bias  removal, 
however,  does  not  solve  the  dynamic  range  problem 
since  the  processing  is  done  after  the  detection  of  the 
signal.  Also,  an  additional  constraint  is  placed  on  the 
resolution  of  the  detector,  since  the  pixel  separation 
must  be  less  than  one-half  of  the  period  of  the  carrier 
being  recorded,  which  will  result  in  a  significant  reduc¬ 
tion  in  the  available  space-bandwidth  product  at  the 
output. 

In  this  paper  a  new  method  for  performing  time- 
integrating  correlation  is  described  using  a  photore¬ 
fractive  bismuth  silicon  oxide  (BSO)  crystal  as  the 
time-integrating  element.  The  correlation  is  formed 
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on  a  spatial  carrier  in  the  crystal  and  read  out  with  an 
auxiliary  beam.  Since  only  the  signal  recorded  on  a 
spatial  carrier  is  stored  in  the  photorefractive  crystal, 
the  diffracted  light  that  is  detected  contains  the  corre¬ 
lation  information  without  the  bias.  The  bias  does  not 
reduce  the  dynamic  range  of  the  output  detector  used 
for  final  readout,  but  rather  the  diffraction  efficiency 
of  the  BSO  crystal.  In  addition,  the  resolution  of  the 
BSO  crystal  is  very  much  higher  than  that  of  a  CCD 
detector,  allowing  the  correlation  of  very  high  space- 
-bandwidth  signals  to  be  formed  on  a  carrier.  Finally, 
since  the  result  of  the  time-integrating  correlator  is 
read  out  optically,  the  output  can  be  easily  interfaced 
with  other  optical  systems,  thus  making  new  architec¬ 
tural  designs  possible. 

In  Sec.  II,  the  theory  of  optical  recording  in  photore¬ 
fractive  crystal  is  reviewed  and  extended  to  the  use  of 
photorefractive  crystals  as  time-integrating  elements. 
The  architecture  and  experimental  results  are  de¬ 
scribed  in  Sec.  III.  Dynamic  range,  linearity,  system 
limitations,  and  other  performance  aspects  are  dis¬ 
cussed  in  Sec.  IV. 

R.  Photorefractive  Crystal*  as  Time-Integrating  Optical 
Detectors 

When  a  photorefractive  BSO  crystal  is  illuminated 
by  an  intensity  grating,  electrons  are  excited  from 
traps  into  the  conduction  band.  These  charges  mi¬ 
grate  due  to  diffusion  and  drift  from  an  externally 
applied  electric  field  and  then  recombine  in  dark  re¬ 
gions,  creating  a  spatially  varying  internal  space- 
-charge  field.  This  field  modifies  the  index  of  refrac¬ 
tion  in  the  crystal  through  the  linear  electrooptic  effect 
and,  as  a  result,  a  holographic  phase  grating  is  recorded 
in  the  crystal.  Grating  formation  in  photorefractive 
media  has  been  extensively  studied  and  modeled.3  4 
We  will  show  here  that  the  photorefractive  crystal  acts 
as  a  time-integrating  element. 

Let  the  intensity  incident  on  the  crystal  be  as  fol¬ 
lows: 
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f/0  +  Re|/.(i,()  explifci)|  for  (  >  0 
/(*./)  =  {  0  (1) 
10  otherwise. 

Assuming  that  self-diffraction  effects  are  negligible 
and  that  the  spatial  variations  of  I[(x,t)  are  small  com¬ 
pared  to  the  grating  frequency  k,  the  intensity  of  the 
light  that  is  diffracted  when  the  crystal  is  illuminated 
by  a  readout  beam  can  be  shown  to  be5 


K,  ['  I,(x,n  2 

/ I)  *  — exp(— t/r)  I  — - exp(f'/r)df'  /„.  (2) 

r  Jo  /  u 


In  is  the  intensity  of  the  readout  beam  and  K\  is  a 
complex  constant  involving  the  material  parameters  of 
the  crystal,  the  grating  frequency,  and  the  applied 
electric  field,  r  is  the  complex  time  constant  of  the 
space-charge  field  and  is  given  by:l  r  =  KJI0.  K;  is 
also  a  complex  constant  that  depends  on  the  photore- 
fractive  material  used  and  the  experimental  condi¬ 
tions.  /o  is  the  average  light  intensity  incident  on  the 
crystal  during  exposure. 

If  /i(x,f )  is  expanded  into  its  temporal  Fourier  com¬ 
ponents, 


/,(*,{')  =  f  )  expfiii’Odu , 


then  the  output  intensity  for  t  »  r  can  be  written  as 
follows: 

K,  f *  J.(x.u)  2 

'-U’0S  V/J-.  ,l7r-+llr,eX,,0U’ndU' 

The  above  is  recognized  to  be  a  low  pass  filter  with 
cutoff  frequency  1/ 1  r  | ,  which  is  approximately  equiv¬ 
alent  to  the  output  of  a  sliding  window  integrator,  with 
integration  time  r.  Thus, 


K,  [<*'  /,u,n  2 

/ou,(x,f)a  —  ——df  /„. 
r  «i> 


Hence,  the  output  intensity  can  be  treated  as  the 
square  of  the  normalized  integration  of  the  signal  I\. 
An  interesting  observation  is  that,  if  I\(x,t)  were  inde¬ 
pendent  of  time,  the  output  intensity  depends  only  on 
the  ratio  of  the  modulated  intensity  I \  to  the  dc  inten¬ 
sity  /0. 


III.  Experimental  Demonstration 

A  schematic  diagram  of  the  experimental  system  is 
shown  in  Fig.  1.  The  input  electrical  signals  are  mixed 
with  the  center  frequency  of  the  acoustooptic  devices 
(AODs)  and  fed  into  the  AODs.  The  first  AOD  is 
illuminated  by  a  collimated  wave  and  the  upshifted 
diffracted  order  is  imaged  onto  the  second  AOD,  then 
reimaged  onto  the  photorefractive  BSO  crystal.  The 
second  AOD  is  oriented  such  that  the  acoustic  signal  is 
counterpropagating  with  respect  to  the  image  of  the 
acoustic  signal  from  the  first  AOD.  The  undiffracted 
light  transmitted  through  the  first  AOD  is  incident  at 
the  Bragg  angle  of  the  second  AOD.  The  upshifted 
diffracted  order  of  the  second  AOD  is  also  imaged  onto 
the  BSO  crystal.  The  undiffracted  light  is  spatially 
filtered  before  reaching  the  BSO  crystal.  In  this  ar¬ 
rangement,  the  AODs  are  parallel  to  each  other,  but 
the  diffracted  ord°rs  propagate  at  an  angle  with  re¬ 
spect  to  each  other  even  though  both  diffracted  beams 
are  temporally  upshifted.  This  causes  the  signals 
from  the  two  AODs  to  interferometrically  record  the 
correlation  signal  on  the  BSO  crystal  at  a  high  spatial 
frequency.  Let  the  inputs  to  the  AODs  be  Oi(t)  =  a(t) 
exp (iw0t)  and  v  >(t)  =  b(t)  exp(iu>0t),  where  u<o/2v  is  the 
center  frequency  of  the  AOD.  The  intensity  incident 
on  the  photorefractive  crystal  is 

Hx,f)  =  |o((  -  x/i  )  exp(i-yx)  +  b(t  +  x/v)  exp(-i>x)|  J 

=  lull  -  t/rl|'  +  |/>U  +  x/f)|J 

+  2  lie  |<i(l  -  x/v)b'[l  +  x/v)  exp(i2>i )],  (5) 

where  v  is  the  acoustic  velocity  of  the  AOD  and  >  = 
u\Jv.  We  will  treat  the  case  where  |a(t)|-  and  |6(f)|2 
can  both  be  approximated  as  constants,  as  is  the  case 
for  FM  signals.  Then,  the  intensity  pattern  can  be 
separated  into  a  dc  term  /0  and  a  signal  term  /iU,f) 
modulating  a  spatial  carrier  cos(2yx)  in  the  form  of  Eq. 
(1).  This  intensity  pattern  results  in  the  formation  of 
a  hologram  on  the  photorefractive  crystal  as  described 
in  the  previous  section.  The  hologram  is  read  out  with 
an  auxiliary  beam  and  is  imaged  onto  a  charge  coupled 
device  (CCD)  detector  for  readout. 

If  the  assumption  is  valid  that  l\(x,t)  has  spatial 
frequencies  which  are  small  compared  with  the  carrier 
frequency  2y,  we  can  use  Eq.  (4)  to  obtain  an  expres¬ 
sion  for  the  output  intensity  detected  by  the  CCD: 
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Fig.  2.  Output  of  a  standard  time- integrating  correlator  without 


n 


Fig.  3.  Output  of  the  bias  removal  correlator  without  noise. 


K i  2  ['*'  aU  -  xMb" 

*  '  M2  +  l 


a  /, 


and  by  defining  variable  tt  =  t  -  x/v, 

/^.(x)  «  f  a<f ,)fe*(f ,  +  2x/i’)df|  •  (6) 

Jf+X/l' 

Hence  the  system  produces  the  magnitude  square  of 
the  correlation  between  the  signals  a(t)  and  6(t)  inte¬ 
grated  over  a  finite  interval  r. 

Flint  glass  acoustooptic  cells  driven  at  a  center  fre¬ 
quency  of  70  MHz  were  used  in  the  experiment.  A 
symmetric  linear  chirp  signal  with  bandwidth  A/  =  5 
Mhz  was  fed  into  each  cell  to  produce  the  autocorrela¬ 
tion  peak.  The  Bragg  angle  of  the  AODs  was  0.2° , 
which  corresponded  to  a  grating  frequency  equal  to  35 
lines/mm  in  the  BSO  crystal. 

The  BSO  crystal  used  in  the  experiment  was  cut  in 
the  (110)  direction  and  measured  15X15X2  mm.  An 
external  electric  Held  of  7  kV/cm  was  applied  in  the 
(001  >  direction  of  the  crystal  which  was  also  the  direc¬ 
tion  of  the  grating  vector. 

The  correlation  was  recorded  on  the  crystal  with  an 
argon  laser  at  a  wavelength  of  514  nm  with  average 
intensity  equal  to  1  jiW/cm2.  The  correlation  was  read 
out  with  a  He-Ne  laser  (X  =  633  nm)  with  150-pW/cm2 
intensity.  Cylindrical  lenses  (not  shown  in  Fig.  1) 
were  used  to  expand  the  output  of  the  AODs  thereby 
illuminating  the  full  aperture  of  the  BSO  crystal  and 
also  to  focus  the  diffracted  light  onto  a  1-D  CCD. 

The  output  signal-to-bias  ratio  of  a  conventional 
time-integrating  correlator  is  reduced  when  the  levels 
of  the  two  signals  are  unequal  and/or  if  there  is  addi¬ 
tive  noise  present  in  the  system.  Both  conditions  were 
simulated  experimentally.  Noise  was  simulated  by 
adding  a  70-MHz  signal  to  the  input  of  one  of  the 
AODs.  The  output  of  a  standard  time-integrating 
correlator  (i.e.,  the  correlation  formed  directly  on  the 
CCD)  for  the  noise-free  case  and  equal  amplitude  sig¬ 
nals  is  shown  in  Fig.  2.  This  condition  provides  the 
maximum  signal-to-bias  ratio  for  the  system.  We  can 


Fits.  4.  Output  of  the  bias  removal  correlator  with  a  signal -to-noise  Fig.  5.  Output  of  the  bias  removal  correlator  with  a  signal-to-noise 
ratio  of  OdB,  ratio  of -10  dB. 
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see  in  Fig.  2  that  there  is  still  a  strong  bias  term  added 
to  the  correlation  peak.  The  correlation  produced  by 
temporally  integrating  on  the  photorefractive  crystal 
is  shown  in  Fig.  3.  In  this  case,  all  the  bias  due  to 
temporal  integration  is  removed,  and  any  residual  bias 
is  due  entirely  to  dark  current  from  the  CCD.  The 
outputs  of  the  bias  removal  correlator  with  input  sig- 
nal-to-noise  ratios  of  0  and  - 10  dB  are  shown  in  Figs.  4 
and  5,  respectively.  Again,  bias  levels  which  appear  in 
the  figures  were  entirely  due  to  the  integration  of  dark 
current  in  the  output  detector.  In  practice,  the  detec¬ 
tor  dark  current  can  be  minimized  by  increasing  the 
intensity  of  the  readout  beam,  thereby  decreasing  the 
required  integration  time  of  the  output  CCD  detector 
and/or  cooling  the  detector. 

HI.  Performance 

The  experimental  results  described  in  the  previous 
section  show  a  dramatic  qualitative  improvement  in 
the  correlation  that  is  obtained  when  the  photorefrac¬ 
tive  crystal  is  used  instead  of  the  CCD.  In  this  section 
we  examine  certain  characteristics  of  this  method 
which  are  useful  for  quantitatively  evaluating  its  per¬ 
formance.  Specifically,  we  examine  the  linearity,  in¬ 
tegration  time,  dynamic  range,  and  sensitivity  of  the 
correlator. 

A.  Linearity 

In  a  conventional  time-integrating  correlator  (co¬ 
herent  or  incoherent),  the  output  correlation  is  basi¬ 
cally  proportional  to  the  signals  applied  to  the  AODs. 
Nonlinearities  occur  only  when  we  exceed  the  linear 
dynamic  range  of  the  devices  used,  i.e.,  if  the  diffrac¬ 
tion  efficiency  of  the  AOD  exceeds  several  percent  or 
the  integrating  detector  is  driven  to  saturation.  In  the 
photorefractive  time-integrating  processor,  the  output 
intensity  is  a  nonlinear,  monotonically  increasing 
function  of  the  input  voltage.  The  nonlinearity  arises 
because  of  the  square-law  detection  at  the  final  read¬ 
out  stage  and  the  recording  mechanism  in  the  photore¬ 
fractive  crystal.  The  nonlinear  relationship  is  now 
studied  analytically  and  experimental  verification  of 
the  theoretical  results  is  presented. 

Letci(t)  *  sit)  be  a  fixed  reference  signal  and  o2(0  85 
as(f)  be  an  input  signal  of  varying  amplitude  (0  <  o  < 
1).  Since  the  correlation  term  contains  spatial  fre¬ 
quencies  which  are  much  lower  than  the  grating  fre¬ 
quency,  near  the  correlation  peak  (x  =  0)  the  intensity 
incident  on  the  photorefractive  crystal  is 

*  (1  +  a2  +  2 a  co8Ax)|s(t)|2. 

Using  Eq.  (1),  the  output  intensity  at  the  CCD  is  pro¬ 
portional  to 


The  modulation  depth  of  the  intensity  incident  on  the 
BSO  crystal  is 

2  a 

m  * -  . 

1  +  a- 

and  hence 


Fig.  6.  Normalized  output  intensity  vs  modulation  depth. 


I 


Fig.  7.  Theoretical  plot  of  output  intensity  vs  input  voltage  ratio. 


“  m2  *  4a2/(l  +  o2l.  (7) 

Figure  6  is  a  graph  of  the  output  intensity  at  the 
correlation  peak  vs  the  modulation  depth  incident  on 
the  crystal.  The  experimental  result  is  in  excellent 
agreement  with  the  square-law  relationship  predicted 
by  Eq.  (7). 

A  plot  of  the  output  intensity  as  a  function  of  the 
amplitude  of  the  input  signal  a  is  shown  in  Fig.  7.  The 
nonlinear  relationship  between  the  input  and  output 
signals  is  generally  a  disadvantage  since  the  scaling  of 
signals  of  varying  amplitudes  will  be  nonlinear.  This, 
however,  will  not  cause  a  problem  if  the  correlator  is 
used  only  as  a  signal  detection  device,  since  correlation 
peaks  will  still  be  discernible  and  only  the  threshold 
level  need  be  adjusted  accordingly  to  maximize  the 
probability  of  detection. 

B.  Integration  Time 

In  a  conventional  time-integrating  correlator,  the 
integration  time  is  limited  by  the  dark  current  buildup 
on  the  output  detector,  typically  up  to  several  hundred 
milliseconds.  When  the  photorefractive  crystal  is 
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Fig.  8.  Output  intensity  at  correlation  peak  vs  time  as  a  function  of 
different  average  incident  intensities. 


used,  the  integration  time  is  determined  by  the  rise 
time  of  the  internal  space-charge  field  which  can  easily 
be  made  much  longer.  The  correlation  can  be  read  out 
at  any  rate  that  is  convenient  by  an  auxiliary  detector 
array. 

The  integration  time  is  approximately  equal  to  |r|, 
where 


M«  f 
*0 


Hence,  the  integration  time  of  the  bias  removal  cor¬ 
relator  can  be  controlled  by  varying  the  writing  inten¬ 
sity.  This  control  is  important  since  the  integration 
time  can  be  matched  to  the  length  of  the  reference 
signal  thereby  increasing  the  probability  of  detection 
of  a  weak  signal. 

The  time  response  of  the  correlation  peak  for  differ¬ 
ent  values  of  average  incident  intensity  is  shown  in  Fig. 
8.  Figure  9  is  a  plot  of  intensity  vs  the  inverse  of  the 
experimentally  observed  rise  time.  There  is  excellent 
agreement  between  the  experiment  and  Eq.  (8). 

The  integration  time,  however,  has  a  finite  range 
over  which  it  can  be  adjusted.  The  maximum  integra¬ 
tion  time  is  limited  by  the  thermal  effects  in  the  crys¬ 
tal.  If  the  rate  at  which  carriers  are  generated  ther¬ 
mally  becomes  comparable  with  the  rate  at  which  they 
are  photogenerated,  the  modulation  depth  of  trap  den¬ 
sity  will  be  reduced.  As  a  result,  the  diffraction  effi¬ 
ciency  of  the  grating  will  decrease.  In  practice,  the 
minimum  integration  time  is  limited  by  the  maximum 
light  intensity  that  is  available  for  recording.  The 
integration  time  can  be  reduced  to  30  msec  if  the 
incident  intensity  is  made  equal  to  18  mW/cm2.  This 
power  level,  however,  is  simply  not  practical  for  most 
applications. 


C.  Dynamic  Range  and  Sensitivity 

Since  the  output  of  the  bias  removal  correlator  is 
presented  without  bias,  the  output  dynamic  range  of 
the  system  is  essentially  equal  to  the  dynamic  range  of 
the  readout  detector  array.  To  characterize  the  per¬ 
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Fig.  9.  Inverse  of  the  rise  time  vs  average  incident  intensity. 


formance  of  the  system  we  need  to  determine  how  the 
input  signal  levels  are  mapped  to  this  output  dynamic 
range.  Let  the  dynamic  range  of  the  photorefractive 
crystal  be  defined  as  DRbso  *  m,n„/mmin,  where  mma 
is  the  maximum  modulation  depth  (mmaI  *  1),  and 
mmin  is  the  minimum  modulation  depth  for  which  a 
diffracted  signal  is  detectable  above  the  output  scatter 
and  noise  level  of  the  system. 

Given  two  input  signals  oi(t)  *os(t)and  u2(f)  *s(t), 
the  modulation  depth  of  the  light  incident  on  the  crys¬ 
tal  is  m  =  2a/(a2  +1).  Thus,  the  minimum  detectable 
input  signal  is  given  by  amin  =  mm  j2  =  l/DRBso-  The 
useful  range  over  which  a  can  vary  is  limited  by  DRbso- 
From  amin,  one  can  define  an  input  dynamic  range 
given  by  DRjnput  =  l/a2min  =  4/m2mm.  The  most  im¬ 
portant  parameter  in  determining  the  system  dynamic 
range  is  the  minimum  detectable  modulation  depth 
mmj„.  Experimentally,  we  measured  the  dynamic 
range  to  be  equal  to  23  dB.  This  corresponds  to  a 
minimum  modulation  depth  of  0.142.  We  expect  that 
through  careful  design  this  can  be  substantially  im¬ 
proved.  However,  all  the  mechanisms  that  determine 
mmw  are  not  fully  understood.  It  is  believed  that 
besides  detector  noise  and  scattering  from  the  crystal, 
the  modulation  depth  is  limited  by  thermal  effects  in 
the  material  and  shot  noise  arising  from  the  internal 
currents. 

Another  important  aspect  of  the  correlator  system  is 
its  sensitivity  or  the  minimum  signal-to-noise  ratio 
that  is  detectable.  This  parameter  is  also  determined 
by  the  minimum  detectable  modulation  depth,  mm 
Given  a  reference  signal  i >\(t)  =  as(t)  and  an  input 
signal  contaminated  by  additive  noise,  u2 (()  *  bs(t)  + 
nit),  the  modulation  depth  of  the  intensity  incident  on 
the  crystal  is 


2ot>|s(f>|i! 

(a2  +  fr’>|sUH-'  +  "n2 


The  reference  level  which  maximizes  m  is  given  by  a  * 
(b-  +  <Tn2/|s(f)|-)l/2,  corresponding  to  a  modulation 
depth  of 
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In  practice,  optimizing  the  reference  level  can  easily  be 
achieved  by  setting  the  power  of  the  reference  equal  to 
the  total  average  power  of  the  input  signal. 

Normalizing  the  signal  and  noise  terms  such  that 
|s(f)|2  *  <r„2  =  1  we  obtain 

b 

m“<62+  1),/J' 

Thus,  the  minimum  input  SNR  that  produces  a  detect¬ 
able  correlation  peak  at  the  output  is  (S/N)mjn  = 

(b2/on2)  min  »  mmin2‘ 

From  the  experimentally  measured  value  of  mm im 
the  correlator  should  have  had  a  sensitivity  of —17  dB. 
However,  experimental  results  showed  a  sensitivity  of 
-14  dB. 

IV.  Conclusion 

The  photorefractive  time-integrating  processor  that 
has  been  described  has  several  advantageous  features: 
bias  removal,  increase  in  the  output  space-bandwidth 
product,  and  the  ability  to  directly  interface  the  result 
of  the  time-integrating  processor  with  other  optical 
systems.  Bias-free  correlation  is  desirable  because  it 
allows  us  to  increase  the  dynamic  range  and  hence  the 
sensitivity  of  time-integrating  processors.  In  the  im¬ 
plementation  described  in  this  paper,  however,  the 
square-law  detection  at  the  output  reduces  the  avail¬ 
able  overall  dynamic  range.  A  definite  improvement 
in  dynamic  range  can  be  obtained  if  the  correlation 
that  is  formed  in  the  photorefractive  crystal  is  interfer- 
ometTically  detected  on  the  output  detector.  Another 
limitation  of  the  system  described  here  is  the  long 
integration  time  (several  seconds).  In  some  applica¬ 
tions  this  long  integration  time  is  desirable  and  could 


result  in  extremely  good  sensitivity  (detection  of  sig¬ 
nals  with  very  low  SNR).  However  it  is  certainly 
desirable  to  be  able  to  decrease  the  integration  time  to 
Several  milliseconds.  This  could  be  accomplished  by 
increasing  the  optical  power  of  the  writing  beams,  but 
this  is  in  general  an  impractical  solution.  Another 
limitation  of  this  technique  is  the  relatively  low  dif¬ 
fraction  efficiency  that  is  obtained  with  BSO  crystals 
(2-3%),  which  reduces  the  overall  light  efficiency. 
Materials  with  higher  electrooptic  coefficients,  such  as 
barium  titanate,  can  provide  better  efficiency;  howev¬ 
er,  the  time  constant  obtained  with  this  particular 
material  is  much  longer  than  that  of  BSO.  New  pho¬ 
torefractive  materials  currently  being  developed  show¬ 
ing  promise  of  a  large  improvement  in  optical  sensitiv¬ 
ity  as  well  as  higher  electrooptic  coefficients  may 
provide  a  substantial  improvement  in  performance 
and,  specifically,  reduce  the  total  optical  power  that  is 
required. 

This  work  is  supported  by  the  Air  Force  Office  of 
Scientific  Research  and  the  Army  Research  Office. 
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Optical  implementation  of  the  Hopfield  model 


Nabii  H.  Farhat,  Demetri  Psaltis,  Aluizio  Prata,  and  Eung  Paek 


Optical  implementation  of  content  addreaaable  associative  memory  baaed  on  the  Hopfield  model  for  neural 
networks  and  on  the  addition  of  nonlinear  iterative  feedback  to  a  vector-matrix  multiplier  is  described.  Nu¬ 
merical  and  experimental  results  presented  show  that  the  approach  is  capable  of  introducing  accuracy  and 
robustness  to  optical  processing  while  maintaining  the  traditional  advantages  of  optics,  namely,  parallelism 
and  massive  interconnection  capability.  Moreover  a  potentially  useful  link  between  neural  processing  and 
optics  that  can  be  of  interest  in  pattern  recognition  and  machine  vision  is  established. 


I.  Introduction 

It  is  well  known  that  neural  networks  in  the  eye-brain 
system  process  information  in  parallel  with  the  aid  of 
large  numbers  of  simple  interconnected  processing  el¬ 
ements,  the  neurons.  It  is  also  known  that  the  system 
is  very  adept  at  recognition  and  recall  from  partial  in¬ 
formation  and  has  remarkable  error  correction  capa¬ 
bilities. 

Recently  Hopfield  described  a  simple  model1  for  the 
operation  of  neural  networks.  The  action  of  individual 
neurons  is  modeled  as  a  thresholding  operation  and 
information  is  stored  in  the  interconnections  among  the 
neurons.  Computation  is  performed  by  setting  the 
state  (on  or  off)  of  some  of  the  neurons  according  to  an 
external  stimulus  and,  with  the  interconnections  set 
according  to  the  recipe  that  Hopfield  prescribed,  the 
state  of  all  neurons  that  are  interconnected  to  those  that 
are  externally  stimulated  spontaneously  converges  to 
the  stored  pattern  that  is  most  similar  to  the  external 
input.  The  basic  operation  performed  is  a  nearest- 
neighbor  search,  a  fundamental  operation  for  pattern 
recognition,  associative  memory,  and  error  correction. 
A  remarkable  property  of  the  model  is  that  powerful 
global  computation  is  performed  with  very  simple, 
identical  logic  elements  (the  neurons).  The  intercon¬ 
nections  provide  the  computation  power  to  these  simple 
logic  elements  and  also  enhance  dramatically  the  stor- 
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age  capacity;  approximately  N/ 4  InJV  bits/neuron  can 
be  stored  in  a  network  in  which  each  neuron  is  con¬ 
nected  to  N  others.2  Another  important  feature  is  that 
synchronization  among  the  parallel  computing  elements 
is  not  required,  making  concurrent,  distributed  pro¬ 
cessing  feasible  in  a  massively  parallel  structure.  Fi¬ 
nally,  the  model  is  insensitive  to  local  imperfections 
such  as  variations  in  the  threshold  level  of  individual 
neurons  or  the  weights  of  the  interconnections. 

Given  these  characteristics  we  were  motivated  to 
investigate  the  feasibility  of  implementing  optical  in¬ 
formation  processing  and  storage  systems  that  are  based 
on  this  and  other  similar  models  of  associative  memo¬ 
ry.3,4  Optical  techniques  offer  an  effective  means  for 
the  implementation  of  programmable  global  intercon¬ 
nections  of  very  large  numbers  of  identical  parallel  logic 
elements.  In  addition,  emerging  optical  technologies 
such  as  2-D  spatial  light  modulators,  optical  bistability, 
and  thin-film  optical  amplifiers  appear  to  be  very  well 
suited  for  performing  the  thresholding  operation  that 
is  necessary  for  the  implementation  of  the  model. 

The  principle  of  the  Hopfield  model  and  its  impli¬ 
cations  in  optical  information  processing  have  been 
discussed  earlier.5,6  Here  we  review  briefly  the  main 
features  of  the  model,  give  as  an  example  the  results  of 
a  numerical  simulation,  describe  schemes  for  its  optical 
implementation,  then  present  experimental  results 
obtained  with  one  of  the  schemes  and  discuss  their 
implications  as  a  content  addressable  associative 
memory  (CAM). 

II.  Hopfield  Model 

Given  a  set  of  M  bipolar,  binary  (1,-D  vectors  vfml, 
i  *  1,2,3  . .  .N,  m  -  1,2,3  . .  .M,  these  are  stored  in  a 
synaptic  matrix  in  accordance  with  the  recipe 

M 

T„  -  L  v}"*v}-'.  ij  -  1,2,3. .  .N,  T„  -  0,  (1) 

1 

v/"‘  are  referred  to  as  the  nominal  state  vectors  of  the 
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memory.  If  the  memory  is  addressed  by  multiplying 
the  matrix  Ty  with  one  of  the  state  vectors,  say  vI(m<’,,  it 
yields  the  estimate 

♦I**'  -  Z  TyV^'  (2) 

j 

m  £  £ 

;>i  m 

«(AI-  1  )»<"*'+  Z  am^,v  J-»,  (3) 

*i<mo 

where 


a  *  V  v(*»o)_(m) 

j 

❖i(mo1  consists  of  the  sum  of  two  terms:  the  first  is  the 
input  vector  amplified  by  (N  —  1);  the  second  is  a  linear 
combination  of  the  remaining  stored  vectors  and  it 
represents  an  unwanted  cross-talk  term.  The  value  of 
the  coefficients  amjno  is  equal  to  y/N  —  1  on  the  average 
(the  standard  deviation  of  the  sum  of  N  —  1  random 
bits),  and  since  (M  -  1)  such  coefficients  are  randomly 
added,  the  value  of  the  second  term  will  on  the  average 
be  equal  to  V(M  —  1)(N  —  1).  If  N  is  sufficiently 
larger  than  M,  with  high  probability  the  elements  of  the 
vector  V*"10*  will  be  positive  if  the  corresponding  ele¬ 
ments  of  vl<mo,  are  equal  to  +1  and  negative  otherwise. 
Thresholding  of  $}mo)  will  therefore  yield  v}mo): 


v(mol 


-  ngnl*!™”1]  - 


+  1  if  ♦J"°’  >  0 
-1  otherwise. 


(4) 


When  the  memory  is  addressed  with  a  binary  valued 
vector  that  is  not  one  of  the  stored  words,  the  vector- 
matrix  multiplication  and  thresholding  operation  yield 
an  output  binary  valued  vector  which,  in  general,  is  an 
approximation  of  the  stored  word  that  is  at  the  shortest 
Hamming  distance  from  the  input  vector.  If  this  out¬ 
put  vector  is  fed  back  and  used  as  the  input  to  the 
memory,  the  new  output  is  generally  a  more  accurate 
version  of  the  stored  word  and  continued  iteration 
converges  to  the  correct  vector. 

The  insertion  and  readout  of  memories  described 
above  are  depicted  schematically  in  Fig.  1.  Note  that 
in  Fig.  1(b)  the  estimate  ❖J'"0*  can  be  viewed  as  the 
weighted  projection  of  Ty.  Recognition  of  an  input 
vector  that  corresponds  to  one  of  the  state  vectors  of  the 
memory  or  is  close  to  it  (in  the  Hamming  sense)  is 
manifested  by  a  stable  state  of  the  system.  In  practice 
unipolar  binary  (0,1)  vectors  or  words  b,(m’  of  bit  length 
N  may  be  of  interest.  The  above  equations  are  then 
applicable  with  [2b,<m)  —  1)  replacing  vI,ml  in  Eq.  (1)  and 
b}mo'  replacing  vjmo1  in  Eq.  (2).  For  such  vectors  the 
SNR  of  the  estimate  $}mo)  can  be  shown  to  be  lower  by 
a  factor  of  v^.1 

An  example  of  the  Ty  matrix  formed  from  four  binary 
unipolar  vectors,  each  being  N  =  20  bits  long,  is  given 
in  Fig.  2  along  with  the  result  of  a  numerical  simulation 
of  the  process  of  initializing  the  memory  matrix  with  a 
partial  version  of  bj41  in  which  the  first  eight  digits  of  b}41 
are  retained  and  the  remainder  set  to  zero.  The 
Hamming  distance  between  the  initializing  vector  and 
b)41  is  6  bits  and  it  is  9  or  more  bits  for  the  other  three 


v*"* 


(a)  READ-IN  (bl  READ-OUT 

Fig.  1.  (a)  Insertion  and  <b)  readout  of  memories. 


stored  vectors.  It  is  seen  that  the  partial  input  is  rec¬ 
ognized  as  b[4)  in  the  third  iteration  and  the  output  re¬ 
mains  stable  as  b{4)  thereafter.  This  convergence  to  a 
stable  state  generally  persists  even  when  the  Ty  matrix 
is  binarized  or  clipped  by  replacing  negative  elements 
by  minus  ones  and  positive  elements  by  plus  ones  evi¬ 
dencing  the  robustness  of  the  CAM.  A  binary  synaptic 
matrix  has  the  practical  advantage  of  being  more  readily 
implementable  with  fast  programmable  spatial  light 
modulators  (SLM)  with  storage  capability  such  as  the 
Litton  Lightmod.7  Such  a  binary  matrix,  implemented 
photographically,  is  utilized  in  the  optical  implemen¬ 
tation  described  in  Sec.  Ill  and  evaluated  in  Sec.  IV  of 
this  paper. 

Several  schemes  for  optical  implementation  of  a  CAM 
based  on  the  Hopfield  model  have  been  described  ear¬ 
lier.5  In  one  of  the  implementations  an  array  of  light 
emitting  diodes  (LEDs)  is  used  to  represent  the  logic 
elements  or  neurons  of  the  network.  Their  state  (on  or 
off)  can  represent  unipolar  binary  vectors  such  as  the 
state  vectors  b/m>  that  are  stored  in  the  memory  matrix 
Ty.  Global  interconnection  of  the  elements  is  realized 
as  shown  in  Fig.  3(a)  through  the  addition  of  nonlinear 
feedback  (thresholding,  gain,  and  feedback)  to  a  con¬ 
ventional  optical  vector-matrix  multiplier8  in  which  the 
array  of  LEDs  represents  the  input  vector  and  an  array 
of  photodiodes  (PDs)  is  used  to  detect  the  output  vector. 
The  output  is  thresholded  and  fed  back  in  parallel  to 
drive  the  corresponding  elements  of  the  LED  array. 
Multiplication  of  the  input  vector  by  the  Ty  matrix  is 
achieved  by  horizontal  imaging  and  vertical  smearing 
of  the  input  vector  that  is  displayed  by  the  LEDs  on  the 
plane  of  the  Ty  mask  [by  means  of  an  anamorphic  lens 
system  omitted  from  Fig.  3(a)  for  simplicity].  A  second 
anamorphic  lens  system  (also  not  shown)  is  used  to 
collect  the  light  emerging  from  each  row  of  the  Ty  mask 
on  individual  photosites  of  the  PD  array.  A  bipolar  Ty 
matrix  is  realized  in  incoherent  light  by  dividing  each 
row  of  the  Ty  matrix  into  two  subrows,  one  for  positive 
and  one  for  negative  values  and  bringing  the  light 
emerging  from  each  subrow  to  focus  on  two  adjacent 
photosites  of  the  PD  array  that  are  electrically  con¬ 
nected  in  opposition  as  depicted  in  Fig.  3(b).  In  the 
system  shown  in  Fig.  3(a),  feedback  is  achieved  by 
electronic  wiring.  It  is  possible  and  preferable  to  dis¬ 
pose  of  electronic  wiring  altogether  and  replace  it  by 
optical  feedback.  This  can  be  achieved  by  combining 
the  PD  and  LED  arrays  in  a  single  compact  hybrid  or 
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Fig.  2.  Numerical  example  of  re¬ 
covery  from  partial  input;  JV  *  20, 
M  ••  4.  (a)  Stored  vectors,  (b) 
memory  or  (synaptic)  matrix,  (c) 
results  of  initializing  with  a  partial 
version  of  b)41. 
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Fig.  3.  Concept  for  optical  implementation  of  a  content  addressable 
memory  based  on  the  Hopfield  model,  (a)  Matrix-vector  multiplier 
incorporating  nonlinear  electronic  feedback,  (b)  Scheme  for  realizing 
a  binary  bipolar  memory  mask  transmittance  in  incoherent  light. 


monolithic  structure  that  can  also  be  made  to  contain 
all  ICs  for  thresholding,  amplification,  and  driving  of 
LEDs.  Optical  feedback  becomes  even  more  attractive 
when  we  consider  that  arrays  of  nonlinear  optical  light 
amplifiers  with  internal  feedback9  or  optical  bistability 


devices  (OBDs)10  can  be  used  to  replace  the  PD/LED 
arrays.  This  can  lead  to  simple  compact  CAM  struc¬ 
tures  that  may  be  interconnected  to  perform  higher- 
order  computations  than  the  nearest-neighbor  search 
performed  by  a  single  CAM. 

We  have  assembled  a  simple  optical  system  that  is  a 
variation  of  the  scheme  presented  in  Fig.  3(a)  to  simu 
late  a  network  of  N  -  32  neurons.  The  system,  details 
of  which  are  given  in  Figs.  5-8,  was  constructed  with  an 
array  of  thirty-two  LEDs  and  two  multichannel  silicon 
PD  arrays,  each  consisting  of  thirty-two  elements. 
Twice  as  many  PD  elements  as  LEDs  are  needed  in 
order  to  implement  a  bipolar  memory  mask  transmit¬ 
tance  in  incoherent  light  in  accordance  with  the  scheme 
of  Fig.  3(b).  A  bipolar  binary  Tw  mask  was  prepared 
for  M  =  3  binary  state  vectors.  The  three  vectors  or 
words  chosen,  their  Hamming  distances  from  each 
other,  and  the  resulting  T,;  memory  matrix  are  shown 
in  Fig.  4.  The  mean  Hamming  distance  between  the 
three  vectors  is  16.  A  binary  photographic  transpar¬ 
ency  of  32  X  64  square  pixels  was  computer  generated 
from  the  T,;  matrix  by  assigning  the  positive  values  in 
any  given  row  of  T|;  to  transparent  pixels  in  one  subrow 
of  the  mask  and  the  negative  values  to  transparent 
pixels  in  the  adjacent  subrow.  To  insure  that  the  image 
of  the  input  LED  array  is  uniformly  smeared  over  the 
memory  mask  it  was  found  convenient  to  split  the  mask 
in  two  halves,  as  shown  in  Fig.  5,  and  to  use  the  resulting 
submasks  in  two  identical  optical  arms  as  shown  in  Fig. 
6.  The  size  of  the  subrows  of  the  memory  submasks  was 
made  exactly  equal  to  the  element  size  of  the  PD  arrays 
in  the  vertical  direction  which  were  placed  in  register 
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Stored  word*: 


U»r«  1  :  1  1  1  0  0  0  t  1  0  1  0  1  1  1  0  1  1  0  1  1  1  1  0  1  J  0  0  I)  «  0  1  0 
Herd  2  !  0  l  1  I  t  0  I  8  «  t  1  S  I  1  I  t  0  l  0  0  1  1  1  1  (  1  0  1  1  0  1  0 
Herd  3  :  1  8  1  1  0  (  1  1  J  1  1  1  1  1  1  •  0  0  1  •«  1  1  0  0  I  I  1  1  0  0  0  • 


Hanning  distance  fro*  word  to  word: 


HOD 

1 

2 

3 

1 

« 

IS 

14 

2 

15 

0 

19 

3 

14 

19 

0 

Clipped  Denary  matrix: 

0-1  1  1-1-1  1  1  1  1-1  1  l  1  1-1  1-1  1  1  1  1  -1  -l  1  -l  1  -1  -1  -1  -1  -1 

-l  0  1  -1  -1  -1  -1  -1  -1  -1  -1  -1  -1  1-1  1  1  1-1  1  1  1  1  1  1  1  -1  -11-11  -1 

1  1  0  -1  -1  -1  -1  1-1  1  1  1  1  1-1  1-1-1  1-1  1  1-1  t  -1  -1  -1  1-1-1  1-1 

1-1-1  0  1  1  1  1  1  1  1  1  l-l  1  -1  -l  -1  l  -1  -1  -1  -1  -l  -1  -1  11-11-11 
-1-1-1  1  0  1  1-1  1  -1  -1  -1  -1  -1  1-1  1  1-1  1-1-1  1-1  1  1  1-1  1  1-1  1 

-1-1-1  1  1  0  1-1  1-1  -l  -1  -1-1  1-1  1  1-1  1-1-1  l-l  1  1  1-1  1  l-l  1 

1-1-1  l  1  1  0  1  1  1  l  1  1-1  l  -1  -1  -1  1  -1  -1  -1  -1  -1  -1  -1  1  1-1  1-1  1 

1-1  1  1-1-1  1  0  1  1-1  1  1  1  l-l  1-1  1  1  1  1-1-1  1-1  1  -1  -1  -1  -1  -1 

1-1-1  1  1  1  1  1  I  1  1  1  1-1  1  -1  -1  -1  1  -1  -1  -1  -1  -1  -1  -1  1  1-1  1-1  1 

1-1  1  l  -1  -1  1  1  1  0-1  1  1  1  1-1  1-1  1  1  1  1-1-1  1-1  1  -1  -1  -1  -1  -1 

-1-1  1  1-1-1  1-1  1-1  0-1-1  1  1-1-1  1-1-1  1  1  1-1-1  1  1  1  1-1  -1  -l 

1-1  1  1-1-1  1  1  1  1-1  0  l  1  1-1  1-1  1  1  1  1-1-1  1-1  1  -1  -l  -1  -l  -1 

1-1  1  1  -1  -l  1  1  1  1-1  1  0  1  1-1  1-1  1  1  1  1-1-1  1-1  1  -1  -1  -1  -1  -1 

1  1  1  -1  -1  -1  -1  1-1  1  1  1  1  0-1  1-1-1  l-l  1  l-l  l  -t  -l  -l  l  -1  -1  l-l 

1-1-1  1  1  1  1  1  1  1  1  1  1-1  0  -1  -1  -1  1  -1  -1  -1  -1  -1  -1  -1  1  1-1  1-1  1 

-1  1  1  -1  -1  -1  -1  -1  -1  -1  -1  -1  -1  1-1  0  1  1-1  1  1  1  1  l  1  1  -1  -11-11  -1 

1  1-1-1  1  1-1  1-1  1-1  1  1  -1  -l  1  0-1  1  1  -1  -l  -1  l  1  -1  -1  -1  -1  l  1  1 

-1  1  -1  -l  1  1  -1  -1  -1  -l  1  -1  -1  -1  -1  1-1  0  -1  -1  -1  -1  1  l-l  1-1  1  1  1  l  1 

1-1  1  1-1-1  1  1  1  1-1  1  1  1  1-1  1-1  0  1  1  1  -l  -1  1-1  l  -1  -1  -1  -1  -1 

1  1-1-1  1  l  -t  1-1  l-l  1  l  -l  -t  l  l  -t  l  » -1  -1  -1  1  1  -1  -1  -1  -1  1  1  1 

1  1  1  -1  -1  -1  -1  1-1  1  1  1  1  1-1  1-1-1  1-1  0  1-1  1  -l  -1  -1  1  -l  -1  1-1 

1  1  1  -1  -1  -l  -1  1-1  1  1  1  1  l-l  1-1-1  1-1  1  0-1  1  -l  -1  -1  1-1-1  l-l 

-1  1  -l  -l  t  1  -1  -1  -1  -1  1  -l  -1  -1  -l  1  -1  1  -1  -1  -l  -1  0  l  -1  1  -1  1  l  1  1  1 

-1  1  1  -l  -1  -1  -1  -1  -1  -1  -1  -1  -1  1-1  l  1  l-l  1  l  l  1  0  l  1  -l  -11-11  -l 

1  1-1-1  1  1-1  1-1  1-1  1  1-1-1  1  1-1  1  1  -1  -1  -l  1  0  -1  -1  -1  -1  1  1  1 

-1  l  -1  -1  1  1  -1  -1  -1  -1  1  -1  -1  -1  -1  1-1  1  -1  -l  -1  -l  l  1-1  0-1  1  1  1  1  1 

1-1-1  1  1  1  l  1  1  1  1  1  1-1  1  -1  -1  -1  1  -1  -1  -1  -1  -1  -l  -1  0  l-l  1-1  1 

-1-1  1  1-1-1  1-1  1-1  1-1-1  1  1-1-1  1  -l  -1  1  1  1  -l  -1  1  l  0  l-l  -1  -1 

-1  1-1-1  1  1  -1  -1  -1  -l  1  -1  -1  -1  -1  1-1  1  -1  -1  -1  -1  1  1-1  l-l  1  0  1  l  1 

-1  -1  -l  1  1  1  1-1  1  -1  -1  -1  -l  -l  l-l  l  1-1  1-1-1  l-l  1  l  1-1  1  0-1  1  F'S-  *■  stored  words,  their 

-1  1  1  -1  -1  -1  -1  -1  -1  -1  -1  -1  -1  1-1  1  1  1-1  1  1  1  1  1  l  1  -l  -11-10  -1  Hamming  distances,  and  their 

-1-1-1  1  l  1  1-1  1  -1  -1  -1  -1  -1  1-1  1  l-l  1  -l  -1  l-l  l  1  1-1  1  l-l  0  clipped  T,j  memory  matrix. 


against  the  masks.  Light  emerging  from  each  subrow 
of  a  memory  submask  was  collected  (spatially  inte¬ 
grated)  by  one  of  the  vertically  oriented  elements  of  the 
multichannel  PO  array.  In  this  fashion  the  anamorphic 
optics  required  in  the  output  part  of  Fig.  3(a)  are  dis¬ 
posed  of,  resulting  in  a  more  simple  and  compact  sys¬ 
tem.  Pictorial  views  of  the  input  LED  array  and  the 


two  submask/PD  array  assemblies  are  shown  in  Figs. 
7(a)  and  (b),  respectively.  In  Fig.  7(b)  the  left  memory 
submask/PD  array  assembly  is  shown  with  the  submask 
removed  to  reveal  the  silicon  PD  array  situated  behind 
it.  All  electronic  circuits  (amplifiers,  thresholding 
comparators,  LED  drivers,  etc.)  in  the  thirty-two  par¬ 
allel  feedback  channels  are  contained  in  the  electronic 
amplification  and  thresholding  box  shown  in  Fig.  6(a) 
and  in  the  boxes  on  which  the  LED  array.and  the  two 
submask/PD  array  assemblies  are  mounted  (see  Fig.  7). 
A  pictorial  view  of  a  composing  and  display  box  is  shown 
in  Fig.  8.  This  contains  an  arrangement  of  thirty-two 
switches  and  a  thirty-two  element  LED  display  panel 
whose  elements  are  connected  in  parallel  to  the  input 
LED  array.  The  function  of  this  box  is  to  compose  and 
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b 


Fig.  6.  Arrangement  for  optical  implementation  of  the  Hopfield 
model:  (a)  optoelectronic  circuit  diagram,  (b)  pictorial  view. 


b 

Fig.  7.  Views  of  (a)  input  LED  array  and  (b)  memory  submask/PD 
array  assemblies. 

display  the  binary  input  word  or  vector  that  appears  on 
the  input  LED  array  of  the  system  shown  in  Fig.  7(a). 
Once  an  input  vector  is  selected  it  appears  displayed  on 
the  composing  box  and  on  the  input  LED  box  simulta¬ 
neously.  A  single  switch  is  then  thrown  to  release  the 
system  into  operation  with  the  composed  vector  as  the 


Fig.  8.  Word  composer  and  display  box. 


initializing  vector.  The  final  state  of  the  system,  the 
output,  appears  after  a  few  iterations  displayed  on  the 
input  LED  array  and  the  display  box  simultaneously. 
The  above  procedure  provides  for  convenient  exercising 
of  the  system  in  order  to  study  its  response  vs  stimulus 
behavior.  An  input  vector  is  composed  and  its 
Hamming  distance  from  each  of  the  nominal  state 
vectors  stored  in  the  memory  is  noted.  The  vector  is 
then  used  to  initialize  the  CAM  as  described  above  and 
the  output  vector  representing  the  final  state  of  the 
CAM  appearing,  almost  immediately,  on  the  display  box 
is  noted.  The  response  time  of  the  electronic  feedback 
channels  as  determined  by  the  3-dB  roll-off  of  the  am¬ 
plifiers  was  ~60  msec.  Speed  of  operation  was  not  an 
issue  in  this  study,  and  thus  low  response  time  was 
chosen  to  facilitate  the  experiment. 

IV.  Results 

The  results  of  exercising  and  evaluating  the  perfor¬ 
mance  of  the  system  we  described  in  the  preceding 
section  are  tabulated  in  Table  I.  The  first  run  of  ini¬ 
tializing  vectors  used  in  exercising  the  system  were  error 
laden  versions  of  the  first  word  bj".  These  were  ob¬ 
tained  from  b,(1>  by  successively  altering  (switching)  the 
states  of  1,2,3  ...  up  to  IV  of  its  digits  starting  from  the 
Nth  digit.  In  doing  so  the  Hamming  distance  between 
the  initializing  vector  and  b^u  is  increased  linearly  in 
unit  steps  as  shown  in  the  first  column  of  Table  I 
whereas,  on  the  average,  the  Hamming  distance  be¬ 
tween  all  these  initializing  vectors  and  the  other  two 
state  vectors  remained  approximately  the  same,  about 
N/2  =  16.  The  final  states  of  the  memory,  i.e.,  the 
steady-state  vectors  displayed  at  the  output  of  the 
system  (the  composing  and  display  box)  when  the 
memory  is  prompted  by  the  initializing  vectors,  are 
listed  in  column  2  of  Table  I.  When  the  Hamming 
distance  of  the  initializing  vector  from  b!"  is  <11,  the 
input  is  always  recognized  correctly  as  b}u.  The  CAM 
is  able  therefore  to  recognize  the  input  vector  as  b) 11  even 
when  up  to  11  of  its  digits  (37.5%)  are  wrong.  This 
performance  is  identical  to  the  results  obtained  with  a 
digital  simulation  shown  in  parenthesis  in  column  2  for 
comparison.  When  the  Hamming  distance  is  increased 
further  to  values  lying  between  12  and  22,  the  CAM  is 
confused  and  identifies  erroneously  other  state  vectors, 
mostly  bj'11,  as  the  input.  In  this  range,  the  Hamming 
distance  of  the  initializing  vectors  from  any  of  the  stored 
vectors  is  approximately  equal  making  it  more  difficult 
for  the  CAM  to  decide.  Note  that  the  performance  of 
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TafcteL  Optical  CAM  M— c« 


Hamming 
distance  of 
initializing 
vector  from 
b<*> 

Recognized 
vector 
(m  -  1) 

Recognized 

vector 

(m-2) 

Recognized 
vector 
(m  »  3) 

0 

1(1) 

2(2) 

3(3) 

1 

1(1) 

2(2) 

3(3) 

2 

1(1) 

2(2) 

3(3) 

3 

1(1) 

2(2) 

3(3) 

4 

1(1) 

2(2) 

3(3) 

5 

1(1) 

2(2) 

3(3) 

6 

1(1) 

2(2) 

3(3) 

7 

1(1) 

2(2) 

3(3) 

8 

1(1) 

2(2) 

3(3) 

9 

1(1) 

2(2) 

3(3) 

10 

1(1) 

1(1) 

3(3) 

11 

1(1) 

2(2) 

3(3) 

12 

3(3) 

3,2  (3) 

3(3) 

13 

3(3) 

3(3) 

3(5) 

14 

3(3) 

1,5(1) 

3(5) 

15 

1  (OSC) 

1  (1) 

2,3  (2) 

16 

3  (OSC) 

1(1) 

5(5) 

17 

3  (OSC) 

1  (OSC) 

2(2) 

18 

3(3) 

1(5) 

3  (OSC) 

19 

3(5) 

5(5) 

5(2) 

20 

3(1) 

5(5) 

5  (OSC) 

21 

1.2  (T) 

5(5) 

3 (OSC) 

22 

3(1) 

5(5) 

3  (OSC) 

23 

1(1) 

5(5) 

3  (OSC) 

24 

1  <T) 

2(5) 

3(3) 

25 

1  (1) 

5(5) 

3(3) 

26 

1(1) 

5(5) 

3(3) 

27 

l  (T) 

5(5) 

3(3) 

28 

1  (l) 

5(5) 

3(3) 

29 

l  (1) 

5(5) 

3(3) 

30 

10) 

5(2) 

3(3) 

31 

1  (l) 

3(5) 

3(3) 

32 

Id) 

2(5) 

3(3) 

the  CAM  and  results  of  digital  simulation  in  this  range 
of  Hamming  distance  are  comparable  except  for  the 
appearance  of  oscillations  (designated  by  OSC)  in  the 
digital  simulation  when  the  outcome  oscillated  between 
several  vectors  that  were  not  the  nominal  state  vectors 
of  the  CAM.  Beyond  a  Hamming  distance  of  22  both 
the  optical  system  and  the  digital  simulationjdentified 
the  initializing  vectors  as  the  complement  biu  of  b|°. 
This  is  expected  because  it  can  be  shown  using  Eq.  (1) 
that  the  T matrix  formed  from  a  set  of  vectors  bj")  is 
identical  to  that  formed  by  the  complementary  set  b)m>. 
The  complementary  vector  can  be  viewed  as  a  contrast 
reversed  version  ofthe  original  vector  in  which  zeros  and 
ones  are  interchanged.  Recognition  of  a  complemen¬ 
tary  state  vector  by  the  CAM  is  analogous  to  our  rec¬ 
ognizing  a  photographic  image  from  the  negative. 

Similar  results  of  initializing  the  CAM  with  error 
laden  versions  of  b'2’  and  b)11  were  also  obtained.  These 
are  presented  in  columns  2  and  3  of  Table  I.  Here  again 
we  see  when  the  Hamming  distance  of  the  initializing 
vector  from  b'  ",  for  example,  ranged  between  1  and  14. 
the  CAM  recognized  the  input  correctly  as  bj3'  as  shown 
in  column  3  of  the  table  and  as  such  it  did  slightly  better 
than  the  results  of  digital  simulation.  Oscillatory  be¬ 
havior  is  also  observed  here  in  the  digital  simulation 
when  the  range  of  Hamming  distance  between  the  ini- 
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tializing  vector  from  all  stored  vectors  approached  the 
mean  Hamming  distance  between  the  stored  vectors. 
Beyond  this  range  the  memory  recognizes  the  input  as 
the  complementary  of  b'3). 

In  studying  the  results  presented  in  Table  I  several 
observations  can  be  made:  The  optically  implemented 
CAM  is  working  as  accurately  as  the  digital  simulations 
and  perhaps  better  if  we  consider  the  absence  of  oscil¬ 
lations.  These  are  believed  to  be  suppressed  in  the 
system  because  of  the  nonsharp  thresholding  performed 
by  the  smoothly  varying  nonlinear  transfer  function  of 
electronic  circuits  compared  with  the  sharp  thresh¬ 
olding  in  digital  comptations.  The  smooth  nonlinear 
transfer  function  and  the  finite  time  constant  of  the 
optical  system  provide  a  relaxation  mechanism  that 
substitutes  for  the  role  of  asynchronous  switching  re¬ 
quired  by  the  Hopfield  model.  Generally  the  system 
was  able  to  conduct  successful  nearest-neighbor  search 
when  the  inputs  to  the  system  are  versions  of  the  nom¬ 
inal  state  vectors  containing  up  to  ~30%  error  in  their 
digits.  It  is  worth  noting  that  this  performance  is 
achieved  in  a  system  built  from  off-the-shelf  electronic 
and  optical  components  and  with  relatively  little  effort 
in  optimizing  and  fine  tuning  the  system  for  improved 
accuracy,  thereby  confirming  the  fact  that  accurate 
global  computation  can  be  performed  with  relatively 
inaccurate  individual  components. 

V.  Discussion 

The  number  M  of  state  vectors  of  length  N  that  can 
be  stored  at  any  time  in  the  interconnection  matrix  Ti; 
is  limited  to  a  fraction  of  N.  An  estimate  of  M  ^  0.1N 
is  indicated  in  simulations  involving  a  hundred  neurons 
or  less1  and  a  theoretical  estimate  ofM  as  N/4  InN  has 
recently  been  obtained.2  It  is  worthwhile  to  consider 
the  number  of  bits  that  can  be  stored  per  interconnec¬ 
tion  or  per  neuron.  The  number  of  pixels  required  to 
form  the  interconnection  matrix  is  N 2  Since  such  a  Ty 
memory  matrix  can  store  up  to  M  =  N/4  InN  (N- 
tuples),  the  number  of  bits  stored  is  MN  =  N2/4  InN. 
The  number  of  bits  stored  per  memory  matrix  element 
or  interconnection  is  MN/N2  =  (4  InN)-1,  while  the 
number  of  bits  stored  per  neuron  is  MN/N  =  M. 

The  number  of  stored  memories  that  can  be  searched 
for  a  given  initializing  input  can  be  increased  by  using 
a  dynamic  memory  mask  that  is  rapidly  addressed  with 
different  T,;  matrices  each  corresponding  to  different 
sets  of  M  vectors.  The  advantage  of  programmable 
SLMs  for  realizing  this  goal  are  evident.  For  example, 
the  Litton  Lightmod  (magnetooptic  light  modulator), 
which  has  nonvolatile  storage  capability  and  can  provide 
high  frame  rates,  could  be  used.  A  frame  rate  of  60  Hz 
is  presently  specified  for  commercially  available  units 
of  128  X  128  pixels  which  are  serially  addressed.7  Units 
with  256  X  256  pixels  are  also  likely  to  be  available  in  the 
near  future  with  the  same  frame  rate  capability.  As¬ 
suming  a  memory  mask  is  realized  with  a  Litton 
Lightmod  of  256  X  256  pixels  we  have  N  =  256,  M  = 
0.1N  ^  26  and  a  total  of  26  X  60  =  1560  vectors  can  be 
searched  or  compared  per  second  against  an  initializing 
input  vector.  Speeding  up  the  frame  rate  of  the  Litton 


Lightmod  to  increase  memory  throughput  beyond  the 
above  value  by  implementing  parallel  addressing 
schemes  is  also  possible.  Calculations  show  that  the 
maximum  frame  rate  possible  for  the  device  operating 
in  reflection  mode  with  its  drive  lines  heat  sunk  is  10 
kHz.7  This  means  the  memory  throughput  estimated 
above  can  be  increased  to  search  2.6  X  10s  vectors/sec, 
each  being  256  bits  long,  or  a  total  of  6.7  X  108  bits/sec. 
This  is  certainly  a  respectable  figure,  specially  when  we 
consider  the  error  correcting  capability  and  the  asso¬ 
ciative  addressing  mode  of  the  Hopfleld  model;  i.e., 
useful  computation  is  performed  in  addition  to  memory 
addressing. 

The  findings  presented  here  show  that  the  Hopfleld 
model  for  neural  networks  and  other  similar  models  for 
content  addressable  and  associative  memory  fit  well  the 
attributes  of  optics,  namely,  parallel  processing  and 
massive  interconnection  capabilities.  These  capabili¬ 
ties  allow  optical  implementation  of  large  neural  net¬ 
works  based  on  the  model.  The  availability  of  nonlin¬ 
ear  or  bistable  optical  light  amplifiers  with  internal 
feedback,  optical  bistability  devices,  and  nonvolatile 
high  speed  spatial  light  modulators  could  greatly  sim¬ 
plify  the  construction  of  optical  CAMs  and  result  in 
compact  modules  that  can  be  readily  interconnected  to 
perform  more  general  computation  than  nearest- 
neighbor  search.  Such  systems  can  find  use  in  future 
generation  computers,  artificial  intelligence,  and  ma¬ 
chine  vision. 

The  work  described  in  this  paper  was  performed 
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the  California  Institute  of  Technology.  This  author 
wishes  to  express  his  appreciation  to  CIT  and  the  Uni¬ 
versity  of  Pennsylvania  for  facilitating  his  sabbatical 
leave.  The  work  was  supported  in  part  by  the  Army 
Research  Office  and  in  part  by  the  Air  Force  Office  of 
Scientific  Research. 
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